PCT 



(51) International Patent Classification 5 : 




(11) International Publication Number: 


WO 95/10919 


H04N 7/18 


Al 


(43) Internationa] Publication Date: 


20 April 1995 (20.04.95) 



(21) International Application Number: PCT/US94/01679 

(22) International Filing Date: 14 February 1994 (14.02.94) 



(30) Priority Data: 

107266 
104725 



12 October 1993 (12.10.93) 
14 February 1994 (14.0X94) 



(81) Designated States: AT, AU, BB, BG, BR, BY, CA, CH. CN, 
CZ. DE. DK, ES, FL GB, HU, JP, KP, KR, KZ, LK, LU, 
LV, MG. MN, MW, NL, NO, NZ, PL, PT, RO, RU, SD, 
SE, SK, UA, US, UZ, VN, European patent (AT, BE, CH, 
DE. DK, ES, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE), 
OAPI patent (BF, BJ, CF, CG, CL CM, GA, GN, ML, MR, 
NE, SN, TD, TG). 



(71) Applicant (for all designated Stales except US)i ORAD, INC. 

[US/US]; Law Offices of Morse Geller, Suite 202, 116-16 
Queens Boulevard, Forest Hills, NY 11375 (US). 

(72) Inventors', and 

(75) Inventors/Applicants (for US only): SHARK, Avi [IL/nj; 21 
Ani Maamin Street, Ramat Hasharon 46 212 (IL). TAMIR, 
Michael PL/EL]; 13 Beit Tsuri Street, Ramat Aviv G, Tel 
Aviv 69 122 (ID- 
CM) Agents: GALLOWAY, Peter, D. et al.; Ladas & Parry, 26 West 
61st Street, New York, NY 10023 (US). 



(54) Title: APPARATUS AND METHOD FOR DETECTING, IDENTIFYING AND INCORPORATING ADVERTISEMENTS I 
VIDEO 

(57) Abstract . 

A system (Figs 7 and 8) and method (Fig 1) for video transmission of active 
events, for example sports events, having in the background physical images in 
designated targets, wherein the physical images are electronically exchanged with 
preselected virtual images, so that objects or shadows actually blocking portions of 
the physical images will be seen by viewers as blocking the same portions of the 
virtual images, and the motion of players or a ball blocking the physical image will 
block corresponding regions of the exchanged virtual image, so that the exchanged 
electronic image will remain in the background of the event, exactly as the original 
image. 




FOR THE PURPOSES OF INFORMATION ONLY 

Codes used to identify States party to the PCT on the front pages of pamphlets publishing 
applications under the PCT. 




GA G»bon 



WO 95/10919 



PCT/US94/01679 



2 APPARATUS AND METHOD FOR DETECTING, 
IDENTIFYING AND INCORPORATING ADVERTISEMENTS 

3 IN A VIDEO 
4 

5 

6 The present invention relates to apparatus 

7 and methods for superimposing a small video image into 

8 a larger video image. 
9 

10 
11 

12 international sports events or other 

13 spectacles generally draw the interest and attention of 

14 spectators in many countries. For example, the 

15 Olympics, Superbowl, World Cup, major basketball and 

16 soccer games, auto races etc. fit into this category. 

17 Such events are generally broadcast live by video to a 

18 large international audience. The locale in which 

19 these events take place, such as stadiums or courts, 

20 provide advertising space all around in the form of 

21 signs, posters or other displays on fences and 

22 billboards, and in fact on any unoccupied space 

23 suitably located, including sections of the playing 

24 field. 

25 Due to the nature of the displays, which are 

26 mostly in the form of printed matter, they are not 

27 changed too frequently and remain at least for a day, 

28 or a series or a whole season, and are directed mostly 

29 at local audiences. In cases where two teams from 

30 different countries play each other, the advertisements 

31 are usually arranged so that one side of the stadium 

32 contains advertisements directed to audiences in one 

33 country, while the other side has advertisements 

34 directed to the spectators in the other country. 

35 The video cameras in these instances film the 

36 event from opposite sides of the stadium for their 

37 respective audiences. This of course is logistically 

38 complicated and limits the angle from which the events 
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1 can be seen in either of the countries represented in 

2 the game. 

3 Another limitation to present methods of 

4 advertising is the stringent safety requirements for 

5 positioning the billboards, so as not to interfere with 

6 the game, nor disturb the view of the spectators in the 

7 stadium, nor pose a danger to the players. The 

8 displays must not be too close to the actual field of 

9 action, so as not to distract the players. 
A most serious drawback of the present system 



10 



the 



11 for advertising at major world sports events 

12 fact that although the event is televised live 

13 throughout the world, the actual physical 

14 advertisements in the stadium, because of their broad 

15 international exposure, can only cater to products 

16 having a world market. 

17 Local advertisers can only make use of such 

18 world-class televised events by locally superimposing 

19 messages on the TV screen, or by interrupting the real 

20 time of the event. 

21 Another drawback of the existing system is 

22 that over long time periods, due to the scanning of the 
2 3 TV camera, the signs appear too blurred to be read by 

24 the TV viewers. On many other occasions, only part of 

25 the sign is visible to the TV viewers and the sign 

26 cannot be read. 

27 The following reference, the disclosure of 

28 which is incorporated herein by reference, describes 

29 Gaussian edge detection: 

30 j.f. Canny, "A computational approach to edge 

31 detection", IEEE Trans. Pattern Analysis and Machine 

32 intelligence. Vol. 8,' pp. 679-698, November, 1986. 
33 

34 
35 
36 
37 
38 
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2 
3 

4 The present invention relates to a system and 

5 method for detecting, identifying and scaling in a 

6 video frame, suitable distinct targets and areas and 

7 inserting into these areas virtual images stored in the 

8 memory of the system, so that all objects or shadows in 

9 front of the distinct areas blocking portions thereof 

10 from view will be seen in a video transmission as being 

11 in front of and blocking the same portions of the areas 

12 containing virtual images. 

13 a particular feature of the invention is to 

14 operate the system in real time. The invention also 

15 provides apparatus for operating the system. The 

16 invention is particularly useful for advertising in 

17 sports courts. 

18 it is an object of the present invention to 

19 provide a system and method for video transmission of 

20 active events, for example sports events, having in the 

21 background physical images in designated targets, 

22 wherein the physical images are electronically 

23 exchanged with preselected virtual images, so that 

24 objects or shadows actually blocking portions of the 

25 physical images will be seen by viewers as blocking the 

26 same portions of the virtual images, and the motion of 

27 players or a ball blocking the physical image will 

28 block corresponding regions of the exchanged virtual 

29 image, so that the exchanged electronic image will 

30 remain in the background of the event, exactly as the 

31 original image. 

32 In a preferred embodiment of the present 

33 invention, the physical image to be substituted is 

34 detected, recognized, and located automatically and is 

35 replaced within one TV frame so that the original image 

36 is not perceptible to the TV viewers. In this 

37 embodiment no man. is required in the loop during line 

38 broadcasting. 

3 
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1 Since the same physical image may be captured 

2 by a plurality of TV cameras deployed in various 

3 locations around the court, and each camera usually has 

4 a continuous zoom lens, the system is able to detect 

5 and identify a certain physical target in all possible 

6 spatial orientations and magnifications of the target. 

7 The system is also capable of unequivocally 

8 identifying the scale and perspective of the physical 

9 target and normalizing the implanted virtual image into 
L0 the same perspective. 

L1 Another object of the invention is to provide 

L2 a system and method of implanting in video 

L3 transmission, virtual images in predetermined "free" 

L4 background areas generally unsuitable for displaying 

15 physical signs, like he sports court itself. 

16 in a preferred embodiment of the present 

17 invention, the task of detection and identification of 

18 these free ares is executed automatically. 

19 a further object of the present invention is 

20 to automatically identify cases in which the physical 

21 billboard appears blurred due to camera scanning or 

22 jitter and to replace the blurred sign with a clearer 

23 one or to alternatively apply the same blurring degree 

24 to the replacing sign so that it will have an 

25 appearance similar to its neighboring signs. 

26 yet another object of the present invention 

27 is to automatically identify a case in which only a 

28 small portion of the billboard is visible in the 

29 camera' a field of view and to replace this small 
3 0 portion with the whole image of the original billboard. 

31 still another object of the invention is to 

32 automatically identify cases in which the resolution of 

33 the captured billboard image is not sufficient for the 

34 TV viewers and to electronically replace them with 

35 larger virtual billboards so that their message may be 

36 conveniently captured by the viewers. 

37 Another object of the invention is to perform 

38 the implantation described above on a succession of 
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1 video frames. 

2 Yet another object of the invention is to 

3 provide the above system and method for electronic 

4 exchange or planting of virtual images in real time. 

5 A further object of the invention is to 

6 provide a system and method for video broadcasting the 

7 same event to different populations of viewers in real 

8 time, with different electronic messages substituted in 

9 the spaces occupied by physical displays. 
Still another object of the invention is to 

provide a system and method for utilization of 

12 available space in a stadium unused by physical 

13 displays for the purpose of advertising by planting 

14 therein electronic virtual images during real time 

15 broadcasting of an event taking place in a stadium. 

16 Still a further object of the invention is to 

17 provide apparatus for use in video transmission for 

18 exchanging physical images with virtual images or 

19 planting virtual images in unused background areas 

20 during an event in real time video transmission, 

21 without disturbing the actual transmission of the 

22 event. 

23 In accordance with a preferred embodiment of 

24 the present invention, there is provided a system and 

25 method for broadcasting active events being captured by 

26 a TV camera, wherein virtual images are electronically 

27 substituted in or superimposed on targets selected from 

28 physical displays and preselected background regions, 

29 including an electronic data bank of event locales and 

30 targets therein, a memory unit for storing digitized 

31 virtual images for substitution in the targets, 

32 apparatus for grabbing and digitizing video frames, 

33 apparatus for automatic target searching in digitized 

34 video frames and for detecting targets therein, 

35 apparatus for localization, verifying and identifying 

36 the targets, apparatus for comparing the detected 

37 targets with corresponding targets in the data bank, 

38 apparatus for scaling and identifying the perspective 
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1 of the original target and transforming the virtual 

2 substitute image into the same scale and perspective, 

3 apparatus for real-time video tracking of a detected 

4 target throughout a succession of frames, and for the 

5 identification of target magnification (zoom) or 

6 changes in perspective, apparatus for distinguishing 

7 between non-background objects and shadows that block 

8 portions of the detected targets, apparatus for 

9 electronically transferring the objects and shadows 

10 from the original video frame to the substituted frame, 

11 apparatus for inserting the electronically transformed 

12 virtual image into the video frame substituting the 
original image in the target without this 

14 transformation being perceptible by the viewers, 

15 apparatus for receiving and storing virtual images and 

16 generating a virtual images data bank, apparatus for 

17 generating a locale data bank either prior or during an 

18 event (a learning system) and video signal input-output 

19 apparatus. 

20 For this purpose the system uses a special 

21 method for the automatic detection and identification 

22 of targets using one or more of the following 

23 attributes: 

24 - geometry - such as the physical configuration 

25 of billboards (rectangular shape or parallel lines 

26 attribute) as seen from different angles and 

27 magnifications, 

28 - texture of slogans and graphics - such as for 
2 9 example in posters, 

30 - character recognition, 

31 _ field or court lines - which serve as 

32 references for designating free court areas, 

33 _ standard objects that have typical shape and 

34 texture - such as post, backboard, basket and/or a 

35 player's shirt, 

36 - colour, and 

37 _ objects and shadows temporarily blocking 

38 portions of the image intended to be exchanged. 

Q> 
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1 The method clearly identifies the subject 

2 target at any capturing angle and range and in any zoom 

3 state, . and preferably in real time, so that the 

4 original billboard will not be perceptible to the TV 

5 viewers. The method typically identifies, in any 

6 frame, a relatively large number of targets (up to 20 

7 targets or more in an extreme case) . 

8 Blocking objects and shadows are 

9 distinguished from the background image by means of: 

10 comparing the detected target (partially blocked) 

11 with the same target stored in the system's data bank. 

12 The smooth and processed difference image between the 

13 two is the image of hidden surfaces which forms a part 

14 of the blocking object. This procedure may be 

15 implemented also by using correlation windows and 

16 identifying a low value of the correlation coefficient 

17 as being due to occlusion, 

18 motion detection - to identify objects that move 

19 with respect to the background, 

20 texture and geometric shape - distinguishing a 

21 player, ball or shadow from a sign, slogan or graphic 

22 image etc., and 

2 3 colour - and shades of colour. 

24 The electronic exchange is preferably instant 

25 and unnoticeable by the viewer since a perceptible 

26 exchange is usually unaccepted by the TV networks. 

27 Alternatively, it is possible to continuously "fade" 

2 8 the original image while enhancing the virtual image. 

29 False identification of targets and images is 

30 preferably avoided. 

31 The substituted target should be localized to 

32 sub-pixel accuracy so that the replacing target be 

3 3 spatially fixed with respect to the frame during the 

34 whole succession of TV frames in which the target is 

35 inside the camera's field of view. This accuracy is due 

36 to the fact that the human eye is sensitive to sub- 
3 7 pixel motions. 

38 7 
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! The methods preferably employ special 

2 parallel and pipelined processing hardware which will 

3 allow carrying out simultaneously the large number of 

4 operations involved in this process. 

5 The method of this invention preferably uses 

6 two optional sub-systems: 

7 a) Digital Image Converter and Storage Unit - 

8 consisting of an electro-optical scanner for digital 

9 conversion and storage of virtual images, for 

10 constructing a memory unit for images such as 

11 advertisements. The system may also have the 

12 possibility of inputting images such as advertisements 

13 in other ways, as by digital interface (magnetic, 

14 optical disc, communication link) or video port, and 

15 may further include a graphics programme and man- 

16 machine interface for designing virtual images (like 

17 slogans) "on-the-spot". 

18 b) Locale "learning" and storage system - for 

19 creating a data bank of targets and fixed objects in 

20 locales such as stadiums and fields, including: signs 

21 (location, shape, colour and type - one-time, seasonal, 

22 etc.), court markers (lines, colour, goal/basket, 

23 post), etc. 

24 These two sub-systems can operate off-line or 

25 can be part of the basic system. The system can 

26 "learn" the details of the court in the course of a 

27 live event and create/update its data bank for future 

28 use. This can also be done using the trial shots taken 

29 before the event starts. 

30 The method involves the following steps: 

31 when the live or previously recorded video 

32 film is being transmitted, the following steps take 

33 place: 

34 1) Frame grabbing and digitization - each 

35 video frame is grabbed and each pixel value is 

36 digitized and stored in system memory, 

37 .2) Searching - the captured video frame 

38 is scanned to detect either actual physical displays 
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1 (like the icons stored in the memory) or background 

2 regions suitable for implantation whose specifications 

3 have been pre-defined. After detection, suspected 

4 targets, i.e. displays, are checked for unequivocal 

5 identification. This is accomplished by identification 

6 of messages and graphics in the displays, or of colour 

7 and texture attributes using standard pattern 

8 recognition techniques like edge correlation and region 

9 matching methods, character recognition, neutral 

10 network techniques and so on. After the target 

11 (display) has been identified and accurately localized, 

12 its optical magnification and perspective are computed 

13 and the locations of all other stored targets 

14 (displays) in the frame are consecutively predicted 

15 using the locale's lay-out in the data bank, giving the 

16 system positive search clues for additional targets in 

17 the same video frame. 

18 3) Blocked surface identification - when a 

19 given message area or display region is positively 

20 identified in a frame, the target (display) is compared 

21 with its properly scaled stored image (icon) and those 

22 areas of the display that are temporarily blocked by an 

23 object such as by the body of a player, by a ball or a 

24 shadow etc. are revealed after proper smoothing and 

25 processing of the results. The pixel addresses of these 

26 surfaces are stored so that these surfaces will later 

27 be superimposed on the substituted image. 

28 4) Scaling, perspective transformation and 

29 substitution - when a physical image display or a 
3 0 free location is identified and localized, the memory 

31 of the system is searched to find the desired virtual 

32 image to be substituted or implanted. The exchanged 

33 virtual image (patch) is then first normalized to 

34 acquire the proper size and perspective of the original 

35 physical image and identified blocked surfaces are then. 

36 removed, so that the exchanged image looks like a 

37 background display, or as a painted display on the 

38 court. 

9 
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1 5) Real-time video tracking - typically a 

2 given display is visible for a few second before it 

3 moves out of the camera's field of view. The system 

4 preferably uses previous frames' information to track a 

5 given display throughout this succession of frames. To 

6 do that, conventional video tracking techniques, such 

7 as edge, centroid or correlation tracking methods, are 

8 executed. These methods should incorporate subpixel 

9 accuracy estimates. Tracking of players or of the ball 

10 can also be instrumental to identify blocking portions 

11 in the case where target icons are not stored in the 

12 system memory or for implantation in free regions. 

13 There is thus provided, in accordance with a 

14 preferred embodiment of the present invention, 

15 apparatus for advertisement incorporation including a 

16 field grabber operative to grab and digitize at least 

17 one field representing at least a portion of a sports 

18 facility, and an advertisement incorporator operative 

19 to incorporate, into at least one field, an 

20 advertisement whose contents varies over time. 

21 Further in accordance with a preferred 

22 embodiment of the present invention, the advertisement 

23 incorporator includes an advertisement site detector 

24 operative to detect at least one advertisement site in 

25 at least one field on a basis other than location of 

26 the advertisement site relative to the sports facility. 

27 still further in accordance with a preferred 

28 embodiment of the present invention, the advertisement 

29 incorporator is operative to incorporate an 

30 advertisement into at least one field at a partially 

31 occluded advertisement site within the sports facility. 

32 still further in accordance with a preferred 

33 embodiment of the present invention, the contents of 

34 the advertisement varies in accordance with a 

35 predetermined schedule. 

36 Additionally in accordance with a preferred 

37 embodiment of the present invention, the contents of 

38 the advertisement varies in accordance with an external 
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1 input. 

2 Further in accordance with a preferred 

3 embodiment of the present invention, the advertisement 

4 incorporator also includes an audience noise evaluator 

5 operative to detect and evaluate a level of noise 

6 generated by an audience and to provide a noise level 

7 input to the advertisement incorporator and wherein the 

8 contents of the advertisement varies in accordance with 

9 the noise level input. 

!0 There is additionally provided, in accordance 

11 with a preferred embodiment of the present invention, 

12 a method for advertisement incorporation including 

13 grabbing and digitizing at least one field representing 

14 at least a portion of a sports facility, and 

15 incorporating into at least one field, an advertisement 

16 whose contents varies over time. 
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1 

3 The present invention will be understood and 

4 appreciated more fully from the following detailed 

5 description, taken in conjunction with the drawings and 

6 appendices in which: 
7 

8 Fig. 1 is a logical flow diagram of the 

9 processes and tasks required in accordance with a 

10 preferred embodiment of the method of the present 

11 invention; 

12 Fi g. 2 is a block diagram of the basic and 

13 sub-system modules in accordance with a preferred 

14 embodiment of the present invention; 

15 F ig. 3 is a block diagram of a basic 

16 processing unit; 

17 pig; 4 illustrates a minimum basic on-line 

18 system in accordance with a preferred embodiment of the 

19 present invention; 

20 Fig . 5 illustrates a minimum basic off-line 

21 system in accordance with the invention; 

22 pig. 6 illustrates a system in accordance 

23 with a preferred embodiment of the present invention 

24 adapted for cable TV application; 

25 Fig. 7 is a simplified block diagram of a 

26 real time system for advertisement site detection and 

27 advertisement incorporation, constructed and operative 
2 8 in accordance with a preferred embodiment of the 
29 present invention 
30 



Fig. 8 is a simplified block diagram of the 



31 parallel processor and controller of Fig. 



Fig. 9 is a simplified block diagram of an 
alternative embodiment of a real time system for 
advertisement site detection and advertisement 



32 
33 
34 

35 incorporation; 
36 
37 
38 



Fig. 10A is a simplified flowchart of a 
preferred method of operation of the parallel processor 
and controller of Fig. 7, when only a single 
/2- 
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1 advertisement site is to be identified and only a 

2 single advertisement is to be incorporated at that 

3 site; 

4 Fig. 10B is a simplified flowchart of a 

5 preferred method of operation of the parallel processor 

6 and controller of Fig. 7, when a plurality of 

7 advertisement sites is to be identified and a 

8 corresponding plurality of advertisements, which may or 

9 may not differ in content, is to be incorporated at 
10 those sites; 

H Fig. 11 is a simplified flowchart of a 

12 preferred method for performing the segmentation step 

13 of Figs. 10A and 10B; 

14 Fig. 12 is a simplified flowchart of a 

15 preferred model matching method for performing the 

16 advertisement content identification step of Figs. 10A 

17 and 10B; 

18 Fig. 13 is a simplified flowchart of a 

19 preferred method for performing the localization step 

20 of Figs. 10A and 10B; 

21 Fig. 14 is a simplified flowchart of a 

22 preferred method for performing the tracking step of 

23 Figs. 10A and 10B; 

24 Fig. 15 is a simplified flowchart of a 

25 preferred method for performing the occlusion analysis 

26 step of Figs. 10A and 10B; 

27 Fig. 16 is a simplified flowchart of a 

28 preferred method for performing the advertisement 

29 incorporation step of Figs. 10A and 10B; 

30 Fig. 17 is a simplified block diagram of 

31 camera monitoring apparatus useful in conjunction with 

32 the advertisement site detection/incorporation 
3 3 apparatus of Fig. 7; 

34 Fig. 18 is a simplified flowchart of a 

35 preferred method for processing the output of the 

36 occlusion analysis process of Fig. 15 in order to take 

37 into account images from at least one off-air camera; 

38 Fig. 19 is a simplified flowchart of a 

13 



WO 95/10919 



PCT/US94/01679 



1 preferred method for detecting and tracking moving 

2 objects of central interest; and 

3 ■ Appendix A is a computer listing of a 

4 software implemented non-real time system for 

5 advertisement site detection and advertisement 

6 incorporation, constructed and operative in accordance 

7 with an alternative embodiment of the present 

8 invention. 
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2 
3 

4 Referring now to Fig. 1, in a preferred 

5 embodiment of the present invention, the system and 

6 method are designed to automatically perform the 

7 substitution of physical targets with synthetic images 

8 in real time, although a simpler version of the 

9 invention can be used off-line. 

10 when operating the system, the modules 

11 required are illustrated in the block diagram of Fig. 

12 2. These include: 

13 a basic processing unit; 

14 an optional scanner/digitizer used to create the 

15 data bank of synthetic images from still pictures; and 

16 an optional sub-system composed of a TV camera, 

17 digitizer and memory to create the stadium data bank. 

18 As was mentioned before, there may be other methods to 

19 create the data bank of synthetic images. The locale's 

20 (stadium's) data bank may also be created from the 

21 trial shots taken before the game starts or even be 

22 incrementally built in the course of the game by means 

23 of a "learning" process or by using data supplied by 

24 the stadium owner, the advertiser or the TV network. 

25 Fig. 2 illustrates a block diagram of the 

26 apparatus used in the system, wherein 1, 2, . . . .n are a 

27 plurality of TV cameras in different positions, which 

28 are the usual TV network cameras, 3 is the basic 

29 processing unit described in Fig. 3, sub-system 4 

30 converts and stores synthetic images and sub-system 5 

31 is a "learning" and storage system for event locales 

32 and targets therein. The output 6 can be transmitted 

33 by cable, optical fiber or wirelessly. It can also be 

34 displayed and/or recorded. 

35 The basic processing unit required to operate 

36 the system in real-time is shown in Fig. 3. This 
3 7 module comprises: 

38 a frame grabber for colour image acquisition; 
IS 
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1 a plurality of image memories; 

2 a fast parallel processor; 

3 a program memory; 

4 data banks of synthetic images to be substituted 

5 and of locale's lay-outs and target icons; 

6 a man/machine interface for control and for local 

7 display and recording; and 

8 e an image digital to analog converter. 

9 The above apparatus is used to automatically 

10 locate in real time in each video frame, suitable areas 

11 within a stadium which have physical displays or might 

12 be suitable for embodying such displays, and to 

13 substitute for such physical displays, or introduce 

14 into such areas, virtual images which are stored in the 

15 memory of the system to serve as advertisements in the 

16 background. 

17 These electronic inserted images will be seen 

18 by viewers as if they are physical displays located in 

19 a stadium and all action taking place in front of the 

20 actual physical display will appear to the viewer to be 

21 taking place in front of the virtual image as well. 

22 Fig. 4 illustrates an on-line system in 

23 accordance with an aspect of this invention consisting 

24 of a video camera 10, video processing unit 12 and 

25 work station 14 that provides the required man/machine 

26 interface. 

2 7 Fig. 5 illustrates a basic off-line system in 

28 accordance with one aspect of this invention. In this 

29 case, a video tape 20, a video cassette recorder or a 

30 video disk is the input rather than a TV camera and 

31 this is processed by the processing unit 22 and work 

32 station 24 to provide a video tape output 26 with 

33 substituted images. 

34 pig. 6 illustrates yet another application of 

35 the system of this invention, namely a cable TV center. 

36 The center 30 receives transmissions from stations 32 

37 and 34. These transmissions are processed by the 

38 processing unit 22 and work station 24 and broadcast 
16 
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1 with substituted advertisements to subscribers from the 

2 center 30 . 

3 Although a preferred system according to this 

4 invention superimposes blocking objects and shadows on 

5 the virtual images, a less sophisticated and much 

6 cheaper system is also intended as part of this 

7 invention, and that is a system where virtual images 

8 are exchanged for physical without relating to blocking 

9 objects. 

10 such a system can be quite useful for 

11 substituting images in unblocked regions, for example 

12 high up in a stadium. 
Although a preferred embodiment of the 

present invention automatically detects and recognizes 
a given billboard in each TV frame, a less 
sophisticated system is also intended as part of this 
invention. In such a less sophisticated system the 
selection of a given sign to be substituted is done 
"manually" by a pointer such as a light pen or a cursor 
(operated by a mouse) with a human operator in the 
loop. 

This system is mainly off-line. When it is 
used on-line in real time it will be very difficult for 
the operator to perform the pointing task since in a 
typical scenario the sign is cntinuously visible for 
only short periods of a few seconds each. 

In such a mode of operation the replacement 
will nevertheless be perceptible to the TV viewers. 
This annoys the spectators and in many cases is not 
permitted by the TV networks. 

From the above description of the invention, 
it is apparent that the system, method and apparatus 

33 described above can have many applications. Thus, it 

34 is also possible to introduce virtual images, such as 

35 slogans or graphic advertisement, on the uniforms of 

36 players, particularly when a player is shown in close- 

37 up. In such a case, the outline of the player, or at 

38 least his shirt or helmet, would be the target for 

f? 



32 
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1 implanting a virtual image. 

2 Another possible application is the automatic 

3 generation of continuous video films showing only 

4 sequences wherein specific targets, which have been 

5 pre-selected, appear to the exclusion of sequences 

6 where these targets do not appear. Such video films 

7 can be useful for analyzing and monitoring the activity 

8 of specific targets, for example individual players and 

9 their performance throughout an entire team game. This 

10 enables tracking each individual throughout an entire 

11 game without having to replay the entire cassette for 

12 each player. 

13 Another application of this invention is to 

14 generate statistical data of targets such as 

15 advertisements, for example the number of times and 

16 accumulated period that an advertisement appears on 

17 the screen, and to debit acccordingly . 

18 The implanted image can be in the form of a 

19 fixed, blinking or scrolling image, or it may be an 

20 animated film or video clip. 

21 Fig. 7 is a simplified block diagram of a 

22 real time system for advertisement site detection and 
2 3 advertisement incorporation, constructed and operative 

2 4 in accordance with a preferred embodiment of the 

25 present invention. 

26 The apparatus of Fig. 7 includes a video 

27 input source 100, such as a video camera, video 

28 cassette, broadcast, video disk, or cable transmission, 

29 which is connected, via a suitable connector, with a 

30 field grabber 110, preferably, or alternatively with a 

31 frame grabber. Henceforth, use of the term "field 

32 grabber" is intended to include frame grabbers. 

3 3 Th e field grabber 110 provides grabbed and 

34 digitized fields to a parallel processor and controller 

35 ■ 120, described in more detail below with reference to 

36 Fig'. 8, which is preferably associated with a video 

37 display 130 which provides an interactive indication to 

38 a user of advertisement site detection and adver- 
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1 tisement incorporation operations of the system. 

2 preferably a light pen 140 is associated with the video 

3 display 130. 

4 According to an alternative embodiment of the 

5 present invention, the system receives an indication 

6 from a user of the presence in the field of view of one 

7 or more advertisements to be replaced and of the 

8 location/ s thereof. The user input may, for example, be 

9 provided by means of a light pen 140. The indication 

10 provided by the user may comprise a single indication 

11 of an interior location of the advertisement, such as 

12 the approximate center of the advertisement or may 

13 comprise two or four indications of two opposite 

14 vertices or all four vertices, respectively, of an 

15 advertisement to be replaced. 

16 Optionally, the user also provides an 

17 indication of- the contents of the advertisement. For 

18 example, a menu of captions identifying advertisements 

19 to be replaced, may be provided on the video display 

20 130 adjacent or overlaying a display of the playing 

21 field and the user can employ the light pen to identify 

22 the appropriate caption. 

23 An advertisement images and advertisement 

24 arrangement database 150 is provided which may be 

25 stored in any suitable type of memory such as computer 

26 memory or secondary memory, such as a hard disk. The 
2 7 advertisement image and arrangement database 150 

28 typically stores a plurality of advertisement images, 

29 typically still images, including images to be replaced 

30 and/or images to be incorporated into the image of the 

31 playing field, either replacing an existing 

32 advertisement or in a location not presently occupied 

33 by an advertisement. 

34 The database 150 may also include an 

35 indication of the arrangement . of a plurality of 

36 advertisements to be replaced, if the arrangement is 
.37 known ahead of time. Typically, the indication of the 

38 arrangement does not include an indication of the 
If - 
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1 location of each advertisement relative to the playing 

2 field, but instead includes an indication of the order 

3 in which the advertisements to be replaced will be 

4 arranged in the field. For example, a sequence of 20 

5 side-by-side advertisements may be arranged around 

6 three sides of a playing field. The database 150 may 

7 then include an indication of the sequence in which the 

8 advertisements are arranged. 

9 Advertisement images in the database 150 may 

10 be provided by field grabber 110 or from any suitable 

11 advertisement image source 160, such as but not limited 

12 to an image generating unit such as a image processing 

13 workstation, a scanner or other color reading device, 

14 any type of storage device, such as a hard disk, a CD 

15 ROM driver, or a communication link to any of the 

16 above. 

17 The video output of the system may be 

18 provided via a suitable connector to suitable equipment 

19 for providing wireless or cable transmission to 

20 viewers. 

21 Fig. 8 is a simplified block diagram of the 

22 parallel processor and controller 120 of Fig. 7. The 

23 parallel processor/controller 120 preferably includes 

24 an advertisement site detection/content identification 

25 unit 170, a plurality of parallel tracking modules 180, 

26 an occlusion analysis and advertisement incorporation 

27 unit 190, a video encoder 200 and a controller 210. 

28 The advertisement site detection/content 

29 identification unit 170 of Fig. 8 may be implemented 

30 based on a suitable plurality of suitable image 

31 processing boards, such as Ariel Hydra boards, 

32 commercially available from Ariel, USA. Each of these 

33 preferably incorporates four TMS320C40 digital signal 

34 processors, a DRAM of 64 MB, an SRAM of 1 MB, and a VME 

35 bus interface. A specially designed coprocessor is 

36 preferably added to these boards to perform the 

37 segmentation task. The image processing boards are 

38 programmed based on the advertisement site detection 

BO 
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1 and content identification methods of Figs. 11 and .12 

2 on which Appendix A is based in part. For example, the 

3 appropriate portions of the listing of Appendix A may 

4 be converted into Assembler and the resulting code may 

5 be loaded into the digital signal processor of the 

6 image processing board. 

7 Each of parallel tracking modules 180 may be 

8 implemented based on one or more image processing 

9 boards, such as Ariel Hydra boards, commercially 

10 available from Ariel, USA. Each of these preferably 

11 incorporates four TMS320C4O digital signal processors, 

12 a DRAM of 64 MB, an SRAM of 1 MB, and a VME bus 

13 interface. The image processing boards are programmed 

14 for parallel operation based on the tracking method of 

15 Fig. 14 on which Appendix A is based in part. For 

16 example, the appropriate portions of the listing of 

17 Appendix A may be converted into Assembler and the 

18 resulting code may be loaded into the digital signal 

19 processor of the image processing board. 

20 The occlusion analysis and advertisement 

21 incorporation unit 190 may also be based on one or more 

22 texture mapping boards such as the Fairchild's Thru-D 

2 3 boards with the appropriate bus bridges, programmed 

24 based on the occlusion analysis and advertisement 

25 incorporation methods of Figs. 15 and 16 on which 

26 Appendix A is based in part. For example, the 

27 appropriate portions of the listing of Appendix A may 

28 be converted into Assembler and the resulting code may 

29 be loaded into the processor of the texture mapping 

3 0 board. 

31 Video encoder 200 is operative to perform D/A 

32 conversion. 

33 Controller 210 may, for example, comprise a 

34 4 86 PC programmed based on the control method of Figs. 

35 10A - 10B on which Appendix A is based in part. For 

36 example, the appropriate portions of the listing of 

37 Appendix A may be Intel 486 PC processor. 

38 Fig. 9 is a simplified block diagram of an 



WO 95/10919 



PCTAJS94/01679 



1 alternative embodiment of a real time system for 

2 advertisement site detection and advertisement 

3 incorporation. In the apparatus of Fig. 9, a 

4 conventional workstation 212, having its own video 

5 display 220 and its own field grabber (not shown) , such 

6 as a Silicon Graphics Onyx workstation loaded with a 

7 video board and a suitable software, replaces the 

8 following units of Fig. 7: field grabber 110, the 

9 parallel processor and controller 120 other than • the 

10 advertisement site detection and content identification 

11 unit 170 and tracking modules 180 thereof, the video 

12 display, and the database 150. 

13 The software for the workstation may be based 

14 on the Appendix A implementation of the method of Figs. 

15 10A - 10B, suitably converted into the workstation's 

16 environment, however some of the functions of Appendix 

17 A are preferably omitted. Specifically: 

18 a. the advertisement site detection and 

19 tracking functions, corresponding to the segmentation, 

20 advertisement content identification and tracking steps 

21 320, 330 and 310 respectively of Figs. 10A - 10B are 

22 omitted and are instead implemented in real time by 

23 dedicated hardware 230 in Fig. 9; and 

2 4 b. The texture mapping functions (second and 

25 third steps of Fig. 16) which preferably form part of 

26 the advertisement incorporation function, are 

27 preferably omitted and are, instead, performed by the 
2 8 texture mapping functions provided by the workstation 

29 itself. 

30 The dedicated hardware 230 of Fig. 9 may be 

31 similar to the advertisement site detection/content 

32 identification unit 170 and parallel tracking modules 

33 180 of Fig. 8. 

34 Appendix A is a computer listing of a non- 
35 real time software implementation of the present 

36 invention which is operative, for example, on a 4 86 PC 

37 in conjunction with a conventional frame grabber such 

38 as an Imaging MFG board. The method of Appendix A is 

•22- 
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1 now described with reference to Figs. 10A - 16. 

2 Fig. 10A is a simplified flowchart of a 

3 preferred method of operation of the parallel processor 

4 and controller 120 of Fig. 7, when only a single 

5 advertisement site is to be identified and only a 

6 single advertisement image is to be incorporated at 

7 that site. 

8 t pig. 10B is a simplified flowchart of a 

9 preferred method of operation of the parallel processor 

10 and controller 12 0 of Fig. 7 , when a plurality of 

11 advertisement sites is to be identified and a 

12 corresponding plurality of advertisement images, which 

13 may or may not differ in content, is to be incorporated 

14 at those sites respectively. 

15 The method of Fig. 10B typically includes the 

16 following steps, which are similar to the steps of Fig. 

17 10A which are therefore not described separately for 

18 brevity: 

19 STEP 290: A digitized video field is 

20 received from the field grabber 110 of Fig. 1. 

21 STEP 300: A decision is made as to whether or 

22 not at least one advertisement in the current field was 

23 also present in the previous field (and televised by 

24 the same camera) . If so, the current field is termed a 

25 "consecutive" field and the segmentation, content 

26 identification and localization steps 320, 330 and 340 

27 preferably are replaced only by a tracking step 310. If 

28 not, the current field is termed a "new" field. 

29 if the field is a "consecutive" field, the 

30 plurality of advertisements is tracked (step 310), 

31 based on at least one advertisement which was present 

32 in a previous field, since the present field is a 

33 "consecutive" field. 

34 if the field is a "new" field, the 

35 advertisement site at which an advertisement is to be 

36 incorporated is identified in steps 320, 330 and 340. A 

37 loop is performed for each advertisement from among the 

38 plurality of advertisements to be processed. 
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1 preferably, the segmentation and content identification 

2 steps 320 and 330 are performed only for the first 

3 advertisement processed. 

4 m step 320, a pair of generally parallel 

5 lines is typically detected and the image of the field 

6 is segmented. Specifically, the portion of the field 

7 located within the two detected parallel lines, which 

8 typically correspond to the top and bottom boundaries 

9 of a sequence of advertisements, is segmented from the 

10 remaining portion of the field. 

11 Typically, the segmentation step 320 is 

12 operative to segment advertisements regardless of: 

13 their perspective relative to the imaging camera, the 

14 zoom state of the imaging camera lens, the location of 

15 the advertisement in the field of view (video field), 

16 the angular orientation of the imaging camera relative 

17 to the ground and the location of the TV camera. 

18 The segmentation step 320 is typically 

19 operative to identify an empty or occupied 

20 advertisement site on a basis other than location, such 

21 as but not limited to any of the following, separately 

22 or in any combination: 

23 a . Geometrical attributes of the advertisement's 

24 boundary such as substantially parallel top and bottom 

25 boundaries or such as four vertices arranged in a 

26 substantially rectangular configuration; 

27 b. A color or a combination of colors or a color 

28 pattern, which are known in advance to be present in 

29 the advertisement image. 

30 c . The spatial frequencies band of the 

31 advertisement image, which is typically known in 

32 advance. Typically, the known spatial frequencies band 

33 is normalized by the height of the advertisement which 

34 may, for example, be derived by computing the distance 

35 between a pair of detected horizontal lines which are 

36 known to be the top and bottom boundaries of the 

37 advertisement sequence. 

38 In step 330, the content of the portion 
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1 between the two substantially parallel lines is matched 

2 to a stored representation of an advertisement to be 

3 replaced. 

4 Steps 320 and 330 allow advertisement sites 

5 to be identified and the content thereof to be matched 

6 to a stored model thereof, even if cuts (transitions, 

7 typically abrupt, between the outputs of a plurality of 

8 cameras which are simultaneously imaging the sports 

9 event) occur during the sports event. Typically, at 

10 each cut, steps 320 and 330 are performed so as to 

11 identify the advertisement within the first few fields 

12 of the cut. Until the next cut occurs, the identified 

13 advertisement is typically tracked (step 310). 

14 in step 340, the advertisement is localized 

15 at subpixel accuracy. 

16 Finally, for each advertisement, occlusion 

17 analysis is performed (step 350) and the replacing 

18 advertisement is incorporated in the advertisement site 

19 (step 360). Alternatively, the occlusion analysis and 

20 advertisement incorporation steps are replaced by an 

21 advertisement enhancement step in which the existing 

22 advertisement is enhanced, using conventional edge 

23 sharpening techniques, rather than being replaced. 

24 Optionally, a fee accumulation step 362 is 

25 performed, typically after occlusion analysis step 350. 

26 In the fee accumulation step, a fee for each 

27 advertisement is accumulated. The fee may be computed 

28 on any suitable basis. For example, the fee may be 

29 determined by counting the total amount of time for 

30 which the advertisement was displayed and for which at 

31 least 50% of the advertisement was unoccluded, and 

32 multiplying by a fixed dollar rate per time unit. 

33 Alternatively, the proportion of the unoccluded area of 
3 4 the advertisement may be computed for each time 

35 interval, such as each second. Optionally, the display 

36 time or the sum over time of the displayed area may be 

37 adjusted to take into account the game's progress. For 

38 example, the display time or the sum over time of the 

2-S . 
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1 displayed area may be multipled by an externally 

2 provided index indicating the tension level of the game 

3 during display of the advertisement. High tension level 

4 may, for example, mean that the game has gone into 

5 overtime or that a significant event, such as a goal, 

6 has occurred during display or just before display. 

7 Alternatively, the tension level index may be provided 

8 by? the system itself. For example, a voice recognition 

9 unit may recognize significant words uttered by the 
10 sports commentator, such as the word "goal". 

H According to an alternative embodiment of the 

12 present invention, the segmentation and advertisement 

13 content identification steps 320 and 330 respectively 

14 may be omitted if physical landmarks identifying the 

15 locations of advertisements to be replaced whose 

16 contents is known in advance, are positioned and 

17 captured ahead of time in the playing field. 



18 Fig. 11 is a simplified flowchart of a 

19 preferred method for performing the segmentation step 

20 320 of Figs. 10A and 10B. 

21 The method of Fig. 11 preferably includes the 

22 following steps: 

23 STEP 380: A new field is received and the 

24 resolution thereof is preferably reduced since the 

25 forgoing steps may be performed adequately at a lower 

26 resolution. for example, a low pass filter may be 

27 employed to reduce a 750 x 500 pixel field to 128 x 128 

28 pixels. 

29 STEP 390: Optionally, the low resolution 



30 image is smoothed, e.g. by median filtering or low pass 

31 filtering, so as to remove information irrelevant to 

32 the task of searching for long or substantially 

33 horizontal lines. 

34 STEP 400: Edges and lines (two-sided edges) 

35 are detected, using any suitable edge detection method 

36 such as the Canny method, described by J. F. Canny in "A 

37 computational approach to edge detection", IEEE Trans. 

38 Pattern Analysis and Machine Intelligence, Vol. 8, pp. 
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1 679-698, November, 1986. 

2 STEP 404: The edges detected in step 400 are 

3 thinned and components thereof are connected using 

4 conventional techniques of connectivity analysis. The 

5 edges are thresholded so as to discard edges having too 

6 small a gradient. 

7 STEP 408: The edges detected in steps 400 and 

8 410 are compared pairwise so as to find strips, i.e. 

9 pairs of parallel or almost parallel lines which are 

10 relatively long. If there are no such pairs, the method 

11 terminates. 

12 STEP 412: Find the spatial frequency spectrum 

13 within each strip and reject strips whose spatial 

14 frequency contents are incompatible with the spatial 

15 frequency band expected for advertisements. Typically, 

16 the rejection criterion is such that more than one 

17 strip, such as 3 or 4 strips, remain. 

18 STEP 416: Rank the remaining strips and 

19 select the highest ranking strip. The rank assigned to 

20 a strip depends on the probability that the strip 

21 includes advertisements. For example, the strip in the 

22 lowest location in the upper half of the field is given 

23 higher rank than strips above it, because the strips 

24 above it are more likely to be images of portions of 

25 the stadium. The lowest located strip is more likely to 

26 be the advertisements which are typically positioned 

27 below the stadium. 

28 Strips adjacent the bottom of the field are 

29 given low rank because the advertisements would only be 

30 imaged toward the bottom of the video field if the 

31 playing field is not being shown at all, which is 

32 unlikely. 

33 Fig. 12 is a simplified flowchart of a 

34 preferred model matching method for performing the 

35 advertisement content identification step 330 of Figs. 

36 10A and 10B. Alternatively, advertisement content 

37 identification may be provided by a user, as described 

38 above with reference to Fig. 1. 

2-7 
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1 The method of Fig. 12 is preferably performed 

2 in low resolution, as described above with reference to 

3 step 380 of Fig. 11. The method of Fig. 12 preferably 

4 includes the following steps: 

5 STEP 420: The forgoing steps 424, 430, 436, 

6 440, 444 and 452 are performed for each almost 

7 parallel strip identified in segmentation step 320 of 

8 Fig. 11. 

9 STEP 424: The distance and angle between the 

10 two lines of each strip is computed and the scale and 

11 approximate perspective at which the strip was imaged 

12 is determined therefrom. 

13 STEP 430: During set-up, each advertisement 

14 model is divided into a plurality of windows. Steps 

15 436, 440 and 444 are performed for each window of each 

16 advertisement model. For example, if there are 5 models 

17 each partitioned into 6 windows, this step is performed 

18 30 times. 

19 STEP 436: A one-dimensional similarity search 

20 is carried out for the suitably scaled current model 

21 window k, along the current almost parallel strip. 

22 Typically, a cross-correlation function may be computed 

23 for each pixel along the current strip. 

24 STEP 440: The cross-correlation function 

25 values obtained in step 436 are thresholded. For 

26 example, values exceeding 0.6 may be assigned the value 

27 1 (correlation) whereas values under 0.6 may be 

28 assigned the value 0 (no correlation). The l's are 

29 weighted, depending on the "significance" of their 

30 corresponding windows. The "significance" of each 

31 window is preferably determined during set-up such that 
3 2 windows containing more information are more 

33 "significant" than windows containing little 

34 information. 

35 STEP 444: At this stage, weighted thresholded 

36 cross-correlation function values have been computed 
3 7 which represent the results of matching the contents of 
38 each position along the strip (e.g. of each of a 
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1 plurality of windows along the strip which are spaced 

2 at a distance of a single pixel) to each window of each 

3 model advertisement known to occur within the strip. 

4 The weighted thresholded cross-correlation 

5 function values are accumulated per all windows 

6 composing a model sign or a model strip. 

7 STEP 452: A decision is made as to the 

8 approximate location of the sequence of advertising 

9 models, within the strip. It is appreciated that, once 

10 the location of one advertisement model has been 

11 determined, the locations of the other advertisemnt 

12 models in the same sequence are also determined, 

13 knowing the scale ad approximate perspective of the 

14 imaged strip. 

15 pig. 13 is a simplified flowchart of a 

16 preferred method for performing the precise 

17 localization step 340 of Figs. 10A and 10B. In Fig. 13, 

18 the advertisement model which was approximately 

19 localized by the method of Fig. 12, is localized with 

20 subpixel accuracy. Accurate localization is typically 

21 performed only for new fields. For "consecutive" 

22 fields, the advertisement's location is preferably 

23 measured by video tracking. 

24 The method of Fig. 13 preferably includes the 

25 following steps: 

26 STEP 460: From Fig. 12, the following 

27 information is available per advertisement detected: 

28 one location within the advertisement, such as one 

29 vertex thereof, the advertisement scale height in the 

30 image and its approximate perpsective. This information 

31 is employed to compute the four vertices of each 

32 detected advertisement. 

33 STEP 464: A perspective transformation is 

34 computed which describes how to "transform" the 

35 typically rectangular model into the detected 

36 advertisement area which is typically non-rectangular 

37 due to its pose relative to the imaging camera. 

38 STEP 468: The contents of each of a plurality 
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1 of model tracking windows to which the model is divided 

2 during set up, is mapped into the video field, using 

3 the perspective transformation computed in step 464. 

4 STEP 470: Steps 472 and 476 are performed for 

5 each of the model tracking windows. 

6 STEP 472: The current model tracking window 

7 is translated through a search area defined in the 

8 video field. For each position of the model tracking 

9 window within the search area, a similarity error 

10 function (like cross-correlation or absolute sum of 

11 differences) is computed. Typically, the model tracking 

12 window has 8 x 8 or 16 x 16 different positions within 

13 the search area. 

14 STEP 476: The minimum similarity error 

15 function for the current model tracking window is 

16 found. Preferably, the minimum is found at subpixel 

17 accuracy, e.g. by fitting a two-dimensional parabola to 

18 the similarity error function generated in step 472 and 

19 computing the minimum of the parabola. This minimum 

20 corresponds to the best position, at "subpixel 

21 accuracy", for the current model tracking window within 

22 the video field. 

23 if (STEP 480) the similarity error function 

24 minima are high for all tracking windows, i.e. none of 

25 the tracking windows can be well matched to the video 

26 field, then (STEP 482) processing of the current frame 

27 is terminated and the method of Fig. 10A, from step 320 

28 onward, is performed on the following frame. 

29 STEP 484: Tracking windows which have a high 

30 similarity error function minimum are rejected. 

31 Typically, approximately 30 tracking windows remain. 

32 STEP 4 88 is a stopping criterion determining 

33 whether or not to perform another iteration of 

34 localization by matching tracking windows. Typically, 

35 if the tracking windows' centers are found to converge, 

36 relative to the centers identified in the last 

37 iteration, the process is terminated. Otherwise, the 

38 method returns to step 464. 
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1 STEP 490: Once the tracking window locations 

2 have converged, the perspective transformation between 

3 the images advertisement and its model is recomputed. 

4 Fig. 14 is a simplified flowchart of a 

5 preferred method for performing the tracking step 310 

6 of Figs. 10A and 10B. The method of Fig. 14 preferably 

7 includes the following steps: 

8 STEP 492: A perspective transformation is 

9 performed on the model tracking windows and the 

10 contents thereof are mapped into the video field. This 

11 step employs the system's knowledge of the location of 

12 the advertisement in the previous field and, 

13 preferably, predicted scanning speed of the camera 

14 imaging the sports event. 

15 STEP 496: Steps 498 and 500, which may be 

16 similar to steps 472 and 476, respectively, of Fig. 13, 

17 are performed for each model tracking window. 

18 STEPS 508 AND 512 may be similar to steps 488 

19 and 490 of Fig. 13. 

20 STEP 510: If the window center locations do 

21 not yet converge, step 4 92 is redone, however, this 
2 2 time, the texture mapping is based upon the perspective 

23 transformation of the previous iteration. 

24 STEP 520: The coefficients of the perspective 

25 transformation are preferably temporally smoothed, 

26 since, due to the smoothness of the camera's scanning 

27 action, it can be assumed that discontinuities are 

28 noise. 

2 9 Fig. 15 is a simplified flowchart of a 

3 0 preferred method for performing the occlusion analysis 

31 step 350 of Figs. 10A and 10B. The method of Fig. 15 

32 preferably includes the following steps: 

33 STEP 530: The advertisement image in the video 

34 field is subtracted from its perspective transformed 

35 model, as computed in step 512 of Fig. 14 or, for a new 

36 field, in step 390 of Fig. 13. 

37 STEP 534: Preferably, the identity of the 

38 advertisement image and the stored advertisement is 

3/ 
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1 verified by inspecting the difference values computed 

2 in step 530. If the advertisement image and the stored 

3 advertisement are not identical, the current field is 

4 not processed any further. Instead, the next field is 

5 processed, starting from step 320 of Fig. 10B. 

6 STEP 538: The internal edge effects are 

7 filtered out of the difference image computed in step 

8 530 since internal edges are assumed to be artifacts. 

9 STEP 542: Large non-black areas in the 
10 difference image are defined to be areas of occlusion. 
H STEP 546: The occlusion map is preferably 

12 temporally smoothed since the process of occlusion may 

13 be assumed to be continuous. 

14 Fig. 16 is a simplified flowchart of a 

15 preferred method for performing the advertisement 

16 incorporation step 360 of Figs. 10A and 10B. The method 

17 of Fig. 16 preferably includes the following steps: 

18 STEP 560: The resolution of the replacing 

19 advertisement model, i.e. the advertisement in memory, 

20 is adjusted to correspond to the resolution in which 

21 the advertisment to be replaced was imaged. Typically, 

22 a single advertisement model is stored in several 

23 different resolutions. 

24 STEP 570: The replacing advertisement is 

25 transformed and texture mapped into the video field 

26 pose, using tri-linear interpolation methods. This step 

27 typically is based on the results of step 512 of Fig. 

28 14 or, for a new field, on the results of step 390 of 

29 Fig. 13. 

30 STEP 580: Aliasing effects are eliminated. 

31 STEP 590: The replacing pixels are keyed in 

32 according to an occlusion map. The values of the 

33 replacing pixels may either completely replace the 

34 existing values, or may be combined with the existing 

35 values, as by a weighted average. For example, the 

36 second alternative may be used for edge pixels whereas 

37 the first alternative may be used for middle pixels. 

38 Fig. 17 is a simplified block diagram of 

5>2- 
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1 camera monitoring apparatus useful in conjunction with 

2 a conventional TV camera and with the advertisement 

3 site detection/incorporation apparatus of Fig. 7. If 

4 the parallel processor and controller of Fig. 7 is as 

5 illustrated in Fig. 8, the apparatus of Fig. 17 is not 

6 required and instead, a conventional TV camera may be 

7 employed. However, in the alternative, the automatic 

8 detection and content identification features of the 

9 system may be eliminated, by eliminating unit 170 of 

10 Fig. 8. In this case, the apparatus of Fig. 17 is 

11 preferably provided in operative association with the 

12 TV camera at the stadium or playing field. 

13 The apparatus of Fig. 17 provides camera 

14 information, including the identity of the "on-air" 

15 camera, its lens zoom state and the direction of its 

16 FOV center. This information may be employed, in 

17 conjunction with known information as to the positions 

18 and contents of advertisements in the stadium, in order 

19 to detect, identify and even roughly track each 

20 advertisement. 

21 The apparatus of Fig. 17 includes: 

22 (a) a plurality of conventional TV cameras 600 of 

23 which one is shown in Fig. 17; 

24 (b) for each camera 600, a camera FOV (field of 

25 view) center direction measurement unit 610 at least a 

26 portion of which is typically mounted on the TV camera 

27 600 pedestal; 

28 (c) for each camera 600, a camera lens zoom state 

29 monitoring unit 620 which is typically mounted on the 

30 TV camera 600 pedestal . The monitoring unit 620 

31 receivse an output indication of the zoom state 

32 directly from the zoom mechanism of the camera ; 

33 (d) an "on-air" camera identification unit 630 

34 operative to identify the camera, from among the 

35 plurality of TV cameras 600, which is being broadcast. 

36 This information is typically available from the 

37 broadcasting system control unit which typically re- 

38 ceives manual input selecting an on-air camera, from a 

37 
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1 producer; and 

2 ( e ) a camera information video mixer 640 

3 operative, to mix the output of units 610, 620 and 630 

4 onto the broadcast. Any suitable mixing may be 

5 employed, such as mixing onto the audio channel, mixing 

6 onto the time code, or mixing onto the video signal 

7 itself. 

8 The camera FOV direction measurement unit 610 

9 may be implemented using any of the following methods, 
10 inter alia: 

H a . On-camera NFM (North Finding Module) in 

12 conjunction with two inclinometers for measuring the 

13 two components of the local gravity vector angle with 

14 respect to the FOV center direction; 

15 t,. GPS- (Global Position System) based direction 

16 measurement system; 

17 c . Triangulation - — positioning two RF sources 

18 at two known locations in the playing field or stadium 

19 and an RF receiver on the camera; 

20 d. an on-camera boresighted laser designator in 

21 combination with an off-camera position sensing 

22 detector operative to measure the direction of the beam 

23 spot generated by the lasr designator. 

24 Fig. 18 is a simplified flowchart of an 

25 optional method for processing the output of the 

26 occlusion analysis process of Fig. 15 in order to take 

27 into account images from at least one off-air camera. 

28 If the method of Fig. 18 is employed, a video 

29 compressor and mixer 700 are provided in operative 

30 association with the TV cameras which are imaging the 

31 event at the playing field or stadium, as shown in Fig. 

32 2. The output of the compressor and mixer 700, 

33 comprising compressed images of the playing field as 

34 imaged by all of the TV cameras other than the TV 

35 camera which is "on-air", blended with the broadcast 

36 signal, is broadcast to remote advertisement site 

37 detection/incorporation systems such as that 

38 illustrated in Fig. 7. The transmission provided by 

J? 



WO 95/10919 



PCT/US94/01679 



1 compressor and mixer 700 of Fig. 2 is first decoded and 

. 2 decompressed in step 710 of Fig- 18. 

3 STEP 720: Steps 730, 740 and 750 are repeated 

4 for each advertisement site imaged by the "on air" 

5 camera . 

6 STEP 730: Although it is possible to employ 

7 information from more than one of the "off-air" 

8 cameras, preferably, only a single "off air" camera is 

9 employed to process each advertisement site and the 

10 single "off-air" camera is selected in step 730. For 

11 example, if the apparatus of Fig. 17 is provided, the 

12 output of camera FOV direction measurement unit 610 for 

13 each "off-air" camera may be compared in order to 

14 identify the "off-air" camera whose FOV direction is 

15 maximally different from the FOV direction of the "on- 

16 air" camera. Alternatively, particularly if the appa- 

17 ratus of Fig. 17 is omitted, a single "off-air" camera 

18 may be selected by performing preliminary analysis on 

19 the images generated by each of the "off-air" cameras 

20 in order to select the most helpful "off-air" camera. 

21 For example, the images generated by each "off-air" 

22 camera may be matched to the stored representation of 

23 the advertisement currently being processed. Then, the 
2 4 actual image may be warped and then subtracted from the 
25 stored representation for each "off-air" camera in 

2 6 order to obtain an estimate of the occlusion area for 

27 that camera and that advertisement. The camera with the 

28 minimal occlusion area may then be selected. 

29 STEP 740: The advertisement image of the 

3 0 selected "off-air" camera is warped onto the 

31 advertisement site as imaged by the "on-air" camera. 

32 STEP 750: The warped "off-air" advertisement 

33 image is subtracted from the "on-air" image and the 

34 difference image is filtered in order to compute the 

35 boundary of the occluding object at pixel-level 

36 accuracy. 

37 According to a preferred embodiment of the 

38 present invention, the advertisement to be incorporated 

33 
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1 in a particular location in the playing field or other 

2 locale may vary over time. This variation may be in 

3 accordance with a predetermined schedule, or in 

4 accordance with an external input. For example, a 

5 speech recognition unit may be provided which is 

6 operative to recognize key words, such as the word 

7 "goal" or the word "overtime", on the audio channel 

8 accompanying the video input to the system. In this 

9 way, an advertisement may be scheduled to be 
incorporated at particular times, such as just after a 

11 goal or during overtime. 

12 In the present specification, the term 

13 "advertisement site" refers to a location into which an 

14 advertisement is to be incorporated. If an existing 

15 advertisement occupies the advertisement site, the new 

16 advertisement replaces the existing advertisement. 

17 However, the advertisement site need not be occupied by 

18 an existing advertisement. The term "occluded" 

19 refers to an advertisement site which is partially or 

20 completely concealed by an object, typically a moving 

21 object, in front of it. 

22 A particular feature of the present invention 

23 is that, when it is desired to track an advertisement 

24 site within a larger image, the entire image is not 

25 tracked, but rather only the advertisement site itself. 

26 Another particular feature is that "special" 

27 advertisements may be provided, such as moving, 

28 blinking or otherwise varying advertisements, video 

29 film advertisements, advertisements with changing 
3 0 backgrounds, and advertisements with digital effects. 
31 It is appreciated that the particular 
3 2 embodiment described in Appendix A is intended only to 

33 provide an extremely detailed disclosure of the present 

34 invention and is not intended to be limiting. 

3 5 The applicability of the apparatus and 

36 methods described above is not limited to the 

37 detection, tracking and replacement or enhancement of 
advertisements. The disclosed apparatus and methods 

36 
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1 may, for example, be used to detect and track moving 

2 objects of central interest, as shown in Fig. 19, such 

3 as focal athletes and such as balls, rackets, clubs and 

4 other sports equipment. The images of these moving 

5 objects may then be modified by adding a "trail" 

6 including an advertisement such as the logo of a 

7 manufacturer. 

8 it is appreciated that various features of 

9 the invention which are, for clarity, described in the 

10 contexts of separate embodiments may also be provided 

11 in combination in a single embodiment. Conversely, 

12 various features of the invention which are, for 

13 brevity, described in the context of a single 

14 embodiment may also be provided separately or in any 

15 suitable subcombination. 

16 it will be appreciated by those skilled in 

17 the art that, the invention is not limited to what has 

18 been shown and described hereinabove. Rather, the scope 

19 of the invention is defined solely by the claims which 

20 follow: 
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{inti; double t1,t2; 

f 1 l U "lL a ubleneiem1;t2=ndoublenelern2; 
a=t1-t2; 

i=(a?((a<0)?1:-1):0); 
return i; 

> ==== _ ===== ================== = == ================== 

it _cdecl compare.GOOD_D.R_L«NE ( const void -e.eml.const void 
*elem2 ) 

{int i; double t1 ,t2; 

f^GOOD.DIR.LINneieml^Quai^KGOOD.DH.LINE^Ie^)- 

>Qual; 
a=t1-t2; 

i=(a?((a<0)?1:-1):0); 
return i; 

} === ======================== =: = == 

//============== 



//= 



;:r^c^re_ a nsy_e^ ( const void -eleml .const void *elem2 ) 



{int i; 

double a; _ 
a=«(double ~)elem1 --(double -)elem2, 
i=(a?((a<0)?1:-1):0); 
return i; 

} =-===== 

//==============-== 
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#ifndef COR_FNC 
#define COR_FNC ^ 
#include M projctn8.h" ^ 
include "pic_mch8.h" 
#include "res_mch8.h" 

^^ublemdpj.vaTOAVERAGE.VEC; 

Thr.COLOR_VEC iro,^ ^^^rgb p1 .double 
?oToR^Cte m pla.e.ab S _d»f_1(PCTUrget,PCT Wi n,doub te 
Thr,COLOR_VEC «_v funct)(C0LOR_RGB p1 .double Thre S h_mdl), 

CO AVERAG E _VeC ..AVERAGE.VEC ^ 
COLOR_VEC Co I relation(COLOR_VEC conv,AVERAGE_VEC 
t,AVERAGE_VEC w, 

COLOR VEC^orre^io^single_1(COLOR_VEC conv,AVERAGE_VEC 
t AVERAGE_VEC w, 

double Quiiity(AVERAGE_VEC * UpUneQuahty); 



#endif 
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#ifndef LIBR 
#define LIBR 
#inc!ude "projctn8.h" 
#include "pic_mch8.h" 
#include "res_mch8.h" 
//#include "lin_tm7.h" 

#defme NAME_LENGTH 40 
#define GRAPHMODE 

#endif 



VRES256COLOR 



HI 
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typedef struct { 
int cols, rows; 
int bpp; 

} PHDR; 
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#ifndef PIC.MCH 
#define PIC.MCH 
#include <vmemory.h> 
#include <graph.h> 
#include "projctn8.h" 
#define MED I AN_AREA 49 

typedef unsigned char byte; 

typedef staict 

{short r.g.b;} 

COLOR_RGB; 
class PCT 

{public: 

short s_rows,s_cols; 

unsigned char__far * buffer_now ; 

unsigned char far **pict; 

//======================— ==— ===== 



{buffer_now=NULL; 
pict=NULL; 
s_rows=s_cols=0; 

} 

void free_PCT() 

{int i; 

if(!pict) return; 
for(i=0;i<s_rows;i++) 

free((void __far *)pict[i]); 
buffer_now=NULL; 
pict=NULL; 

void put_str(short y, unsigned char *B) 
{ 

jf(y<s_rows) 

{buffer_now=pict[y]; 

int i; 

for(i=0;i<3*s_cols;i++) 
*buffer_now++=*B++; 

} 

} 

void put_pix(short y.short x,COLOR_RGB p) 

}f((y<s rows) && (x<s_cols)) 

buffer_now = pict{y]+3*x; 
PutNextPix(p); 
} 

43 
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//=======- 

== ^e~COLOR_RGB get_next(void) 
{ COLOR_RGB t; 

t.r=*buffer_now++; 
t.g=*buffer_now++; 
tb=*buffer_now++; 

return t; 

_ * ) = _ ==== =============== : 

JJ^Co!"^ y ' Sh ° rt X) 

{ if((y<s rows) && (x<s_cols)) 

"buffer__now= pict[y]+3*x; 
return get_next(); 
} = _ ======== ========= 



~"void~PutNextPix(COLOR_RGBp); 
int load_f.le_rgb(const char "name); 

COLOR_RGB *make_palette(); 

short color_num(short r.short g^hort b); 

void write_sign_rgb(char *name,PCT p.ct.now), 

#endif 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



#ifndef PIC.PRO 
#defme PIC_PRO 
#indude <stdlib.h> 
#include <direct.h> 
#include <afx.h> 
#include <pic_mch7.h> 
#include "filemnp.h" 
#define STR_MAX 4^ 
//=============== 



const SCR_PNT z_0(0,0); 
class PRT:public PCT 

{public: 
//information 

CString PathName; 
CString FRAME_Numben 
CString STRING_name; 
CString SIGN_name; 

short Pos; // Position in the stnng 
long NumberOfChk,MaxNum; 
double *Charact; 
//models 

PRT::-PRT() 

{this->free_PCT(); 
Pos=0; 

if(MaxNum) 

delete Charact; 
Charact=NULL; 
MaxNum=NumberOfChk-0; 

} 



II- 



PRT"PRT() 

{NumberOfChk=MaxNum=s_cols=s_rows=0; 

Charact=NULL;pict=NULL; 



} 



PRT-PRT (short n_cols, short n_rows) 
{-(PCT -)this=PCT::PCT(n_cols,n_rows); 
NumberOfChk=MaxNum=0; 
Charact=NULL; 

} ====; 



int read_proto_SGN(char ext[]=".sgn") 
^CString new_name(' ',80); 

PathName=MakeName(PathName); 
new_name=PathName+ext; 
char now[80]; 
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' f( ( rf(fscanf(datfp,"%r\n]s T~EOF)gcto ERR. 
if fscanf(datfp,"%s ".now ==EOF go to ERR, 
if fscanf(datfp,"%s ^no^EORgoto ERR, 
if(fscanf(datf Pl "%s ",now)==EOF)goto 
ERR;FRAME_Nun^ber^now;^^ « noW )==EOF)goto 

reSWG iSSi> ".nov^EOFJgoto ERR; SIGN.name^, 
FRAME_Number.MakeUpper(); 
STRING_name.MakeUpper(); 
SIGN_name.MakeUpper(); 
fclose(datfp); 
return 0; 
ERRrfclose (datfp); return 1; 

"rTpVl^ VC) 
~{*(PCT -)this=sign_storage_rgb(name,vc), 

if (ls_cols) return 1; 
pathName=MakeName(name); 

if (read_proto_SGN()) 

{free_PCT(); 
return 1; 
> 

return 0; 
} 

// 



int read_proto_DBC(FiLE *datfp) 

char nowM,^^ , i%s ,, now)==EOF)goto 

ERR; ^'^^^^gl^f^atf^'o^s » t now)==EOF)goto 

ERR;STR«NG^a =p _ f£ S™ —^ 

if(fscanf(datfp,"%d ",&(this->s_cols))==EOF)goto ERR. 
FRAME_Number.MakeUpper(); 
STRING_name.MakeUpper(); 
SIGN_name.MakeUpper(); 
return 1 ; 
ERR: return 0; 

> === -- ====== ======================= 

//============= 

Tnt alloc_Charact_dbl(long Num) 
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{ jf(!(Charact=new double[Num])) return 1; 
MaxNum=Num; NumberOfChk-0; 
return 0; 

} 

II — ' 

void free_Charact() 
{delete Charact; 

Charact=NULL; 

} _ 

fnt read_Charact_dbl(FILE *inp,long Num) 

{short i; 

double d; A 
if(MaxNum<(NumberOfChk+Num)) return 1; 

. for (i=0;i<Num;i++) 

{if(fscanf(inp,"%lf ",&d) ==EOF) return 1 , 
if(fabs(d)<1.0e-4)d=0; 

Charact[NumberOfChk]=d; 
NumberOfChk++; 
} 

return 0; 

} 

double CorrValue(shortWNum,shortPnum) 
{return («(Charact+(long)WNum*s_cols+Pnurn)); 

} ==-========================== 

//=============== 

^======RETURN NUMBER OF STRIPS 

int read_target_SGN{SCR_PNT vrtQ[4],char ext[]= .sgs ) 
{int n=0,j,FLG,s; 
CString new_name(' ',80); 

PathName=MakeName(PathName); 
new_name=PathName+ext; 
char now[80]; 

F,L ff(i?datfp=fopen((const char*)new_name,"r"))) return 1; 
M if(fscanf(datfp,"% Ws ")==EOF)goto OUT; 
if(fscanf(datfp,"%s ",now)==EOF go to OUT; 
if(fscanf(datfp,"%s ",now)==EOF)goto OUT, 
if(fscanf(datfp,"%s ",now)==EOF)goto 
.OUT;STR,N^ = . ., now)==EOF)go(0 0UT; s , GN _ name = W 

if((s=PathName.ReverseFind('\V))<0) 

ssPathName.ReverseFindC:'); 

FRAME_Number= 

PathName.Right(PathName.GetLength()-s), 

HI 
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STRING_name.MakeUpper(); 
S1GN_name.MakeUpper(); 

do{ 

!^lS«(datfp,»%d «d », & (v rt [n m .c).&(vrt[n)g].r)))=EOF) 
goto OUT; 

n++; 

wh?ie(n<STR_MAX-1 ); 
OUT:fclose (datfp); return n; 



#defme UnKnown -1 
//================ 



typedef struct 

{ short n; // voiting numbers 
short pos; // position in string 
double value; //value 
} RSLT_old; 



void HistCollect(short NOfWin.short ^ sh ° rt 

RSLT old LineEstimation (short TagS.ze PRT &Db short NOfW.n, 

^ - short WSize.double Thr), 

. t , . , „ ef p RT xp PRT T short rw, short Xpos.struct _videoconfig vc); 

5* ^ f5SS? PRT &PshortWNum short WSize .double Pt); 
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#ifndef PROJCTN 
#define PROJCTN 
#include <math.h> 
include <graph.h> 
typedef struct { 

double x, y. z; 
}PNT; 

class SCR.PNT 
{public: 
short c, r, 

SCR_PNT(){c=0;r=0;} 
SCR_PNT(short x,short y){c=x;r=y;} 

}; 

//PT -> SCR PNT conversion // . 
#define PT_SCR( P.scr) (scr).c=(short)(p).u;(scr).r=(short)(p).v, 
// SCR PNT -> PT converson 
#defme INT PT(scr.dbl) (dbl).u=(double)((scr).c),\ 
(dbl).v=(double)((scr).r); 

class PT 
{public: 
double u, v; 

PT(double x, double y){u=x; v=y;} 

PT(SCR_PNT p1 ){u=(double)p1.c;v=(double) P 1.n} 

PT (){u=0;v=0;} 

}; 

class LINE_PROJECTION; 
class DIR.LINE 

{ friend class LINE_PROJECTION; 
private: n ■ . . 

double a.b.c; // a*u+b*v+c=0 
PT st_pnt, end_pnt; 
public: 

DIR_LINE (PT p1 , PT p2) 
{st_pnt=p1; 
end_pnt=p2; 

#ifdef DEBUG 

moveto( (short) st_pnt.u,(short) st_pnt.v ), 
_lineto( (short) end_pnt.u,(short) end_pnt.v ); 

#endif 

a=p2.v-p1 .v; 
b=p1 .u-p2.u; 

c= P 1 .v-p2.u- P 1 .u*p2.v; // aWy+c=0 

} 

" DIR_LINE(SCR_PNT P 1,SCR_PNTp2) 
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{stpnt=PT::PT(p1); 
end_pnt=PT::PT(p2); 



#ifdef DEBUG st _p nt . Ui( sho rt ) st_pnt.v ); 

>eto( (short) ind_pnt.u,(short) end_j>nt.v ); 

#endif t , w . 

a=end_pnLv-st_pnt.v, 

b=st_pnt.u-end_pntu; 
c=st^nt.v-end_pnt.u.st_pnt.u*end_pntv, 



a*x+b*y+c=0 
} 



DIR_LINE () 
{st_pnt.u=st_pnt.v= 
end_pnt.u=end_pnt.v=a=b-c=U, 

PT PT_for_P( double p) 

{P Iu=st_pnt.u+p*(end_pnt.u-st_pntu); 
t.v=st_pnt.v+p*(end_pnt.v-st_pnt.v); 

return t; 
doubleU_for_V(double v) 

double V_for_U(double u) {return(b?(-c-a u)/b.O),} 
double a_for_line(){return a;} 
double b_for_line(){return b;} 
double c_for_line(){retum c;} 

double RATlO_for_PT(PT p) //relative point position at line 
{ double dx,dy,dro; 

dx=end_pnt.u-st_pnt. u; 
dy=end_pnt. v-st jpnt. v; 
if(fabs (dx)>fabs(dy)) 
{if(!dx) return 0; 
dro= (p.u-st _pnt.u)/dx; 

} 

else 

if(!dy) return 0; . 
dro= (p.v-st _pnt.v)/dy; 

} 

return dro; 

int Left Right(int col.int row) 

Tl +i if point to the left hand from start to end 
// 0 otherwise 

{ return(((a*col+b-row+c)>=0)?0:1 ); 
} 
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PT Start_p(){retum st_pnt;} 
PT End_p(Kreturn end_pnt;} 
friend intU dist(DIRJJNE I); 

col.int row); 

}; 

class LINE_PROJECTION 
{ 

private: 

double proj_prm; // 
public: 

DIRJJNE Rl, Prj; 

LINE_PROJECTION(){ 

DIRJJNE 11; RI=I1; Prj=l1; 
proj_prm=0; 

LINE_PROJECTION (DIRJJNE 11, PT p, DIRJJNE pr, PT p_pr); 
double Ro_for_P(double P) 

{return ( (P*(1+proj_prm))/(1+P*proLprm)); 

double P_for_Ro(double Ro) 

{return ( Ro/(1+(1-Ro)*proj_prm)); 

friend DIR LINE Line_for_PT_pr(LINE - PROJECTION linel, PT prl, 
LINE.PROJECTION Iine2, PT pr2); 

friend DIR LINE Line_for_PT_rl(LINE_PROJECTION linel, PT p1, 
LINE_PROJECTION Iine2, PT p2); 

}; ================================= 

ciass~GOOD_DIR_LINE:public DIRJJNE 
{public : 

double Qual; 
GOOD DIR_LINE(){Qual=0;} 
GOOdIdIR_LINE(SCR_PNT St,SCR_PNT End) 
{Qual=0; 

•(DIRJJNE -)this=DIR_LINE::DIR_LINE(St,End); 

// void OnDraw(short incr) 
// { PT st=Start_p(). stp=End_p(); 

. h _moveto( (short) st.u,(short) (st.v+incr) ); 

;/ Jineto( (short) stp.u,(short) (stp.v+incr) ); 

// } 

}; 

typedef struct{ LINE_PROJECTION LJeft,L_mid,L_right; 

si 
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DIRJJNE 101, 112, I23, I30; 
DIRJ-INEl01_pr, I12_pr, I23_pr. I30_pr, 



RECT.RESOLVED; 

#endif 
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#ifndef RES_MCH 
#define RES_MCH 
#include <graph.h> 
#include "projctn8.h" 
#include M pic_mch8.h" 
#define NTSC 0 
#define HSI 1 
#define New_plan 2 
#define RGB 3 
#defme LUMIN_THR 4 
#define IHS 5 
//================- 



typedef stoict 

{double c[3]; 
} COLOR_VEC; 

void GRAPH_OUT(int ex=0); 

int GRAPHICS_START( struct _videoconfig *vc,short GR_mode), 
void match_vertex(SCR_PNT *v); ., iaIom , v 
int _cdecl c_comp( const void *elem1 , const void elem2), 
short interpol(short * s.double x,double y); 

COLOR RGB INTER_pix_color_rgb(PCT p1 , PT PT_now); 
COLORlRGB INTERjix:color_rgb_median(PCT P 1, PT PT.now); 

const COLOR_VEC NORM_RGB={256,1,1}; 
const COLOR_VEC NORM_simple={256,256,256}; 

COLOR_VEC <*PointColorFunct(short M))(COLOR_RGB p1. double 
Thresh_mdl); 

COLOR VEC color_space_NTSC(COLOR_RGB P 1 Rouble L^esh mdl); 
COLOR'VEC color S pace_RGB(COLOR_RGB p1, double Thresh i.nwfl . 
COLOR VEC color _ space NEW(COLOR_RGB p1 .double Threshmdl), 
COLORlvic colorlspacelRGB.simplefCOLOR.RGB p1, double 

CoToR^EC color_space_LUMIN_THR(COLOR_RGB p1 , double 
^TSrj5eC color_space_IHS(COLOR_RGB p1, double Thresh_mdl); 
#endif 
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#ifndefVICAL8 
#defme VICAL8 
#include <vmemory.h> 

#endif 
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Sr^ed«eSh=^n.( cons, void -e.eml, cons, void -e,em2 , 
{int i; double t1,t2; 

double a; , _ 

tl=**(double**)elem1;t2=**(double )elem2; 

a=t1-t2; 

i=(a?((a<0)?1:-1):0); 
return i; 

//====================== ========== 

int _cdecl compare_GOOD_DIR_LINE ( const void -eleml.const void 
*elem2 ) 

{int i; double t1 ,t2; 

t^06D_DIR_LINE-)elem1)->Qual ; e=((GO0D.DIR_LINE-)ele m2 )- 

>Qual; 
a=t1-t2; 

i=(a?((a<0)?1:-1):0); 
return i; 

} = — =================== 

//===================-=== 

//============================= =========== 

M = Zrtec^mpare_Brray_e\e™ ( const void *elem1, const void *elem2 ) 
{int i; 
double a; 

a=**(double **)elem1 -"(double **)elem2; 

i=(a?((a<0)?1:-1):0); 

return i; 

} ==================== 

//==================== 
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#include <stdio.h> 
#include <stdlib.h> 
#include <conio.h> 
#inciude <float.h> 
#include <graph.h> 
#include "cor_fnc8.h" 



11= 



{short r_t,c_t,n=0,r, 
AVERAGE_VEC z={{0,0,0},{0,0,0}}, 
COLOR_VEC t_p; 
for(r_t=0;r_t<tag.s_rows;r_t++) 
for(c_t=0;c_t<tag.s_co!s;c_t++) 

( r^p_funct(tag.get_pixel(r_t,c_t),Thr); 
for(i=0;i<3;i++) 

{ z.md[i]+=t_p.c[i]; 
z.var[i]+=t_p-c[i]n_p.c[i]; 

> 

} 

double rr.nrev; 
nrev=n?1.0/n:0; 
for(i=0;i<3;i++) 
{rr=(z.md[i]*=nrev); 
z.var[i]=z.var[irnrev; 

} 

return z; 

} ===================== 

//================= 



COLOrIvEC tem P rate_conv_1 (PCT target,PCT win.double 
Thr.COLOR.VEC in^v.^ rp _ funct)(C0L0R _ RGB P 1 .double Thresh.mdl)) 



{short i.r.c.n; 
COLOR_VEC w_p,t_p; 
COLOR_VEC res={0,0,0}; 



for(n=r=0; . 
(r<target.s_rows)||(r<win.s_rows);r++) 

. f %<ta°rget.s_cols)[|(c<win.s_cols);c++) 

{n++ ' w p=p_funct(win.get_pixel(r,c),Thr); 
t _p=p_funct(target.get_pixel(r,c),Thr); 



for(i=0;i<3;i++) 
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if(int_v.c[i]) 
res.c[i]+=wj3.c[ilt_p.c[i]; 

} 

double nrev; 
nrev=n?1.0/n:0; 
for(i=0;i<3;i++) 

res.c[i]=res.c[i]*nrev; 
return res; 

} =========================*== 

//================= 

^L^^C^tete_abs_difL1 (PCT target,PCT win.double 
Thr,COLOR_VEC in^v. ec funct)(C0L0R _ RGB pl.doub.e Thresh.mdl), 
AV E RAG E_V EC t,AVERAGE_VEC w) 

{short i.r.c.n; 
COLORVEC w_p,tjD; 
COLOR_VEC res={0,0,0},nor={0 1 0,0}; 

for(n=r=0; ' 

(r<target.s_rows)||(r<win.s_rows);r++) 

for(c=0; . v , 

(c<target.s_cols)i|(c<win.s_cols);c++) 

{n++; 

w_p=p_funct(win.get_pixel(r,c),Thr); 
t_p=p_funct(targetget_pixel(r,c),Thr); 

for(i=0;i<3;i++) 

' f( {res V cn^ r ., t ...... 

n^c[i]U_max^bs(w^.c[i].w.md[i]),fabs(tjx[.]-t.md 

// nor.c[i]+=2*fabs(w_p.c[i]-w.md[i]); 
} 

} 

for(i=0;i<3;i++) 

if(int_v.c[i]&& nor.c[i]) 
res.c[i]=1 -res.c[i]/nor.c[i]; 
return res; 

} ========================== 

//=================== 

COLOR_VEC Correlation(COLOR_VEC conv,AVERAGE_VEC 
t,AVERAGE_VEC w, 

COLOR_VEC int_v) 
{COLOR_VEC out; 
int i; 

double p,g; 
for(i=0;i<3;i++) 
if(jnt_v.c[i]) 

ST 
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{p=(cx3nv.ctiKmd[i]*w.md[i]); 
St.vartiHmd[i]n.md[iir(w.v a r[ 1 ]-w.md[.]*w.mdni), 

out.cfl]=g?p*p/g:0'. 

out.c[i]=(p>0)?out.c[i]:-out.c[i]; 
} 

else 

out.c[i]=0.0; 
return out; 



^oToR.VEC Correlation_single„1(COLOR_VEC conv,AVERAGE_VEC 

t,AVERAGE_VEC w, 

COLOR_VEC int_v) 
{COLOR_VEC out; 
int i; 

double sngl_conv=0; 
double sngl_var=0; 
for(i=0;i<3;i++) 
if(int_v.c[i]) 
{ 



VEC LineMoments(PCT &T, DIR_LINE 



Line, short map) 



{COLOR_RGB col; 

AVE^e!!^ 
PT now, 

short length=U_dist( Line); 
double d; ■ 
short j,i ! k,ST_X ; END_X,now_X; 
double relen,delta_V; 
PT st, stop; 
if(length<0) 

{st=Line.End_p(); 

stop=Line.Start_p(); 

length=fabs(length); 

} 

else _ . 

{st=Line.Start_p(); stop=Lme.End_p(); 
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relen= length?1 .0/length:0; 
ST_X=(short)st.u; END_X=(short)stop.u; 

// now.u=ST_X;now.v=d; 
// col=INTER_pix_color_rgb(T, now); 
col=T.get_pixel((short)d,now_X); 

switch (map) 

{case NTSC:; 
case New_plan:; 
case HSI:; 

caselHS:{ # w im 

vc= PointColorFunct(map)(col,0); 

for(k=0;k<3;k++) 
out.md[k]+=vc.c[k]; 

break; 
} 

case RGB: { • 
out.md[0]+=col.n//out.var[0]+=col.r col.r, 

out md[1 ]+=col.g;//out.var[1 ]+=col.g"col.g; 

out.md[2]+=col.b;//out.var[2]+=col.b*col.b; 
break; 

case LUMIN_THR:{ 

out.md[0]+=col.r+col.g+col.b; 

break; 

} 



}; 



}; 



forO=0;j<3;j++) 
{ 

out.md[jr=relen; 
// out.var[j]/=l e n9 th ; 
} 

return out; 

> ========================================== 

double~Quality(AVERAGE_VEC * UpLineQuality) 

{ double J out,out_even=0 1 out_odd=0,out2_even,out2_odd,sum=0; 

for(j=0;j<3;j++) 

{ sum+=(UpLineQuality+0)->mdOl+(UpLineQuaiity+1)->mdG]+ 
51 
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(UpLineQuality + 2)->mdD]+(UpLineQual.ty + 3)->mdD], 
rfo oHH*=out2 odd: 



out2_odd*=out2_odd, 
out_even+=out2_even; 
out_odd+=out2_odd; 

out=(out_even+out_odd)*0.001 ; 
return out; 
} 
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#include<stdlib.h> 
#include<stdio.h> 
#include<graph.h> 
#include<math.h> 
#include <io.h> 
#include<fcntl.h> 
#include <string.h> 
#include <float.h> 
#include <malloc.h> 
#include "phdr.h" 
#include "vical8.h" 
#include "pic_mch8.h" 

int cols, rows; 

PHDR inhdn 
/;================= 

/;================= 



void PCT::PutNextPix(COLOR_RGB p) 

*buffer_now++ = (unsigned char)p.r; 

*buffer_now++ = (unsigned char)p.g; 
*buffer_now ++ = (unsigned char)p.b; 
} 

//================================= 



int _cdecl comparejum ( const void *elem1 .const void *elem2 ) 
{inti; COLOR_RGB t1,t2; 

double a; „ 
t1 =-(COLOR_RGB-)elem1 ;t2="(COLOR_RGB~)elem2; 
a=(t1 .r+t1 .g+t1 .b-t2.r-t2.g-t2.b); 
i=(a?((a<0)?1:-1):0); 
return i; 

} =======- 

//======================== 



;/========================-==-=== 

COLOR_RGB PCT::get_median_pixel(short y.short x.short neibour) 
{COLOR_RGB t={0,0,0}, 

s[MEDIAN_AREA],*lum_order[MEDIAN_AREAJ; 

short n,i,j,xnow,ynow; 
intx3=3*x; 

unsigned char far *buffer1 ;. 

f or(n=0,i=-neibour; i<=neibour; i++) 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCI7US94/01679 



forG=-neibour;j<=neibouni++) 
if(((ynow=y+i)<s_rows) && ((xnow=x+j)<s_cols)) 

{ buffer1= (unsigned char __far*)pict[ynow]; 
tr=*(buffer1 +xnow*3+0); 
t.g="(buffer1 +xnow*3+1 ); 
tb=*(buffer1+xnow*3+2); 
s[nl=t; 

c- *(ium_order+n)=s+n; 
n++; 

qsort((void*)lu m _order,n,sizeof(COLOR_RGB*),compareJunn ); 

t=*lum_order[(n+1)»1]; 
return t; 

} __ _ ==== _ = ======== 

//=================== 



PCT"PCT( short n_cols, short n_rows) 
{ 

(unseed char _far nvirtallotf3*n_coIs,nj-ows); 
if (!pict) 

{fprintf(stderr,"No memory for picture ), 
s_cols=0; 
s_rows=0;- 

return; 

buffer_now=pict[0]; 

s_cols=n_cois; 

s_rows=n_rows; 

} ============ 

voTpCT^ source, SCR.P NT left_up_scr) 

{ 

short r_now, c_now; 
COLOR_RGB color_p; 
unsigned char *BUF,*B; 
BUF=(unsigned char *) malloc((size_t) 

(sizeof(unsigned char)"3*s_cols)); 
if(!BUF) {fprintf(stderr," BUF ");exit(-1);} 
for (r now=0; r_now<s_rows;r_now++) 

{Tor (B=BUF,c_now=0;c_now<s_cols; c_now++) 

{ 

color_p= 

source.get _pixel(r_now+left_up_scr.r,c_now+left_up_scr.c); 
*B++=color_p.r 
*B++=color_p.g; 
*B++=color_p.b; 

} 
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put_str(r_now,BUF); 
} 

free((void*)BUF); 

} ======================== 

//=============—==—= 

int PCT::load_file_rgb(const char *name) 
{ int er_n short bytes; 

int y, infd; 

short ysize, xsize; 

charname_pf_file[18]; 

FILE*datfp; 

strcat(strcpy(name_of_file,name), .rgb ), 

datfp=fopen(name_of_file,"rb"); 
infd= _fileno( datfp ); 

if(infd <= 0) 
{ printf("bad name 1"); 

return(1); 

* er _r=_read(infd, &inhdr, sizeof(PHDR)); 

xsize=cols = inhdr.cols; 
ysize=rows = inhdr.rows; 

•rf(ysize > s_rows ) 

ysize =s_rows; 
if(xsize > s_cols) 
xsize = s_cols; 

s_cols= xsize; 
s_rows=ysize; 
bytes =3 * xsize; 

byte Buf[2040]; 

for(y = 0; y < ysize; y++) { 
read(infd, Buf, 3*cols); 
put_str(y, (unsigned char*)Buf); 

} 

fclose(datfp); 
return 0; 

} 

//========================= == ^ ====== " 

PcTr g nIst = orage_rgb(const char -name, struct .videoconf.g vc) 
{ int er_r; 

fc3 
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PCT pict_now, 

char name_of_file[40]; 

FILE *datfp; 

strcat(strcpy(name_of_flle I name),".rgb ,, ); 
int infd; 

short ysize, xsize; _ 
datfp=fopen(name_of_file,"rb ); 

infd= _fileno( datfp ); 
if(infd <= 0) 
{ printfC'bad name 1"); 
return(pict_now); 

\;r_r=_read(infd, &inhdr, sizeof(PHDR)); 
if(er_r<0) 

{ printf("bad name 1"); 
return(pict_now); 

} 

fclose(datfp); 

xsize=cols = inhdr.cols; 
ysize=rows = inhdr.rows; 
"rf(ysize > vc.numypixels ) 

ysize = vc.numypixels ; 
if(xsize > vc.numxpixels) 
xsize = vanumxpixels; 
pict_now=PCT::PCT(xsize,ysize); 

if(pict_now.s_cols) 

pict_now. load_file_rgb(name); 

return(pict_now); 

} ^ 

CSl^^^rtJRGB(PCT pict_scr,SCR_PNT left.up) 
{short x,y,xsize,ysize; 
COLOR_RGB t; 

xsize= pict_scr.s_cols; 

ysize= pict_scr.s_rows; 
short c; 

forty = o; y < vslze; y ++) . , r , 

{pict_scr.buffer_now=pict_scr.pict[yj; 
for(x = 0; x < xsize; x++) 

* t=pict scr.get_next(); niu ... 

_setcolor(color_num (t.r»2,t.g»2,t.b»2)), 
_setpixel(x+left_up.c,y+left_up.r); 

} 
} 

} 

6V 
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const int stepr=9, stepg=9, stepb=21; 

COLOR_RGB *make_palette() 
{COLOR_RGB -plt=NULL; 

long now,Lut[256]; 

long dr.dg.db; 

short i,j,k,num; 

for(i=0,db=0;i<4;i++,db+=stepb) 
forO=0,dg=0;j<8;j++,dg+=stepg) 
for(k=0,dr=0;k<8;k++,dr+=stepr) 
{ now=(db«16)I(dg«8)|dr; 
num=(i«6)|G«3)|k; 
Lut[num]=now; 

_remapallpalette((long __far *)Lut); 
return pit; 

} ========= _ == ===================== 

short color_num(short r.short g.short b) 
{short num.ij.k; 

i=(b+(stepb»1 ))/stepb; - 

j=(g+(stepg»1 ))/stepg; 

k=(r+(stepr»1 ))/stepr; 
num=(' << 6)IG«3)|k; 
return num; 

} __ ===== _ == - == ===================== 

void write_sign_rgb(char *name,PCT pict_now) 
{ inter_n; 

char name_of_file[80]; 
strcat(strcpy(name_of_file,name), '.rgb ); 

FILE *datfp; 

int y, infd; 

datfp=fopen(name_of_file,"wb"); 
infd= fileno( datfp ); 
if(infd <= 0) 

printf("bad name 1"); 

inhdr.cols=pict_now.s_cols; 

inhdr.rows=pict_now.s_rows; 

inhdr.bpp=3; 

er _r=_write(infd, (void *)(&inhdr), sizeof(PHDR)); 
for(y = 0; y < pict_now.s_rows; y++) 

{ ' 

b5 
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#ifdef VIRTUAL 

V ° ,d ifT(b2rf "void _far *)_v.oad( piot_now.pict[yl._VM_CLEAN )) == 

NULL ) . ... , v 

{_vheapterm();exit( -1 ), 

} 

#else 

void *buffer1; 

buffer1= (void *) pict_now.pict[y]; 
^!51_write(infd, bufferl, sizeof(char)*pict_now.s_cols-3); 
} 

fclose(datfp); 

strcat(strcpy(name_of_file,name), .sgn ), 

datfp=fopen(name_of_file;V); 
fprintf(datfp,"%s \n 0 OW.name); 
fDrintffdatfp "%d O\n",pict_now.s_cols-1 ); 
fpr!ntf(datfp."%d */od ^,pTct_now.s_cois-1,pict_now.s_rows-1); 
fprintf(datfp." 0 %d\n",pict_now.s_rows-1 ); 
fclose(datfp); 

} ========================= 

//==================== 
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#include<stdlib.h> 
#include<stdio.h> 
#include<graph.h> 
#include<math.h> 
#include <io.h> 
#include<fcntl.h> 
#include <string.h> 
#include <float.h> 
//#include <malloc.h> 
//#include "phdr.h" 
//#include "vical8.h" 
#include "picture.h" 



//int cols, rows; 



//PHDR inhdr; ========================== 

'^^^^^^u^^^^^ y - short x * short neibour) 

^s^[l^^AN_AREA] I , *lurn_order[MEDIAN_AREA]; 
short n.i.j.xnow.ynow; 
int x3=3*x; 

unsigned char far *buffer1; 

for(n=0,i=-neibour; i<=neiboun 
for(i=-neibour;j<=neibour;j++) 
if(((ynow=y+i)<s_rows) && ((xnow=x+j)<s_cols)) 

{ buffer1= (unsigned char _far*)pict[ynow]; 
t. r="(buffer1 +xnow*3+0); 
t.g=*(buffer1 +xnow*3+1); 
t.b=*(buffer1 +xnow*3+2); 
s[n]=t; 
*(lum_order+n)=s+n; 

n++;. 

qsorK^oid-Jlum.order.n.sizeonCOLOR.RGB^.compareJum ); 
t=*lum_order[(n+1 )»11; 
return t; 

} =-================= 

//==================== 

PCT"PCT( short n_cols, short n_rows) 
{ 

(unsigned char _far *-)virtalloc(3*n_cols,n_rows); 

if('P'ct) r . t „, 

{fprintf(stderr,"No memory for picture ), 

s_cols=0; 
s_rows=0; 
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return; 

buffer_now=pict[0]; 

s_cols=n_cols; 

s_rows=n_rows; 

} =-_====== 

'^^^^^^^^^-^^^^ 
{ 

short r_now, c_now; 
COLOR_RGB color_p; 
unsigned char *BUF,*B; 
BUF=(unsigned char •) malloc((size_t) 

(sizeof(unsigned char)*3*s_cols)); 
if(!BUF) {fprintffstderr," BUF ");exit(-1);} 
for (r now=0; r_now<s_rows;r_now++) 

{Tor (B=BUF,c_now=0;c_now<s_cols; c_now++) 

{ 

color_p= . 
source.get ^ixeKr.now+left.up.scr.r.c.now+left.up.scr.c); 

' *B++=color_p.r; 
*B++=color_p.g; 
*B++=color_p.b; 

puti.str(r_now, BUF); 
} 

free((void*)BUF); 
} =========== 



int PCT::load_file_rgb(const char *name) 
{ int er_nshort bytes; 

int y, infd; 

short ysize, xsize; 

char name_of_file[1 8]; 

FILE *datfp; m 

strcat(strcpy(name_of_file,name), .rgD ), 

datfp=fopen(name_of_file,"rb"); 
infd= _fileno( datfp ); 

if(infd <= 0) 
{ printf("bad name 1"); 

return(1 j; 

*er_r= read(infd, &inhdr, sizeof(PHDR)); 

xsize=cols = inhdr.cols; 
' ysize=rows - inhdr.rows; 
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if(ysize > s_rows ) 

ysize =s_rows; 
if(xsize > s_eols) 
xsize = s_cols; 

s_cols= xsize; 
s_rows=ysize; 
bytes =3 * xsize; 

. byte Buf[2040]; 

for(y = 0; y < ysize; y++) { 
read(infd, Buf, 3*cols); 
put str(y, (unsigned char*)Buf); 

} 

fclose(datfp); 
return 0; 
} 

//=========================== ======== 

PCT = sSnlstorage.rgbtconst char *name,struct _videoconf,g vc) 

{ inter_r, 

PCT pict_now; 

char name_of_file[40]; 

FILE *datfp; 

strcat(strcpy(name_of_file,name),".rgb"); 
int infd; 

short ysize, xsize; 
datfp=fopen(name_of_file,"rb"); 
infd= _fileno( datfp ); 
if(infd <= 0) 
{ printf("bad name 1"); 
return(pict_now); 

^e^^readCinfd, &inhdr, sizeof(PHDR)); 
if(er_r<0) 

{ printf("bad name 1"); 
return(pict_now); 

} 

fclose(datfp); 

xsize=cols = inhdr.cols; 
ysize=rows = inhdr.rows; 
if (ysize > vc.numypixels ) 

ysize = vc.numypixels ; 
if(xsize > vc.numxpixels) 
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xsize = vc.numxpixels; 
pict_now=PCT::PCT(xsize,ysize); 
if(pict_now.s_eols) 

pict_now.ioad_file_rgb(name); 

retum(pict_now); 
} 



v^WJreMri^GBtPCT pict_scr,SCR_PNT left.up) 
{short x.y.xsize.ysize; 

COLOR_RGB t; 
xsize= pict_scr.s_cols; 
ysize= pict_scr.s_rows; 
short c; 

for(y = 0; y < ysize; y++) 

{pict_scr.buffer_now=pict_scr.pict[yj; 

for(x = 0; x < xsize; x++) 

* t=pict_scr.get_next(); 
_setcolor(color_num(t.r»2 I t.g»2,t.b»2)); 
_setpixel(x+left_up.c I y+!eft_up.r); 

} 
} 

> 



//====================== 

const int stepr=9, stepg=9, stepb=21; 

COLOR_RGB *make_palette() 
{COLOR_RGB *plt=NULL; 

long now,Lut[256]; 

long dr.dg.db; 

short ij.k.num; 

for(i=0.db=0;i<4;i++,db+=stepb) 
fora=0,dg=0;j<8;j++,dg+=stepg) 
for(k=0,dr=0;k<8;k++,dr+=stepr) 
{ now=(db«16)|(dg«8)|dr; 
num=(i«6)|G«3)|k; 
Lut[num]=now; 

_remapallpaiette((long _far *)Lut); 
return pit; 

} —==-========================= 

short color_num(short r.short g.short b) 
. {short num.i.j.k; 

i=(b+(stepb»1 ))/stepb; 
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j=(g+(stepg»1 ))/stepg; 

k=(r+(stepr»1))/stepr, 
num=(i«6)|G << 3)l k ; 
return num; 

} ===== ============================== ==== 

voiT^tT sign_rgb(char Yiame.PCT pict_now) 
{ inter_n; 

char name_of_file[80]; ^ 
strcat(strcpy(name_of_file,name) 1 .rgb ), 

FILE *datfp; 
int y, infd; 

datfp=fopen(name_of_file,'\vb ); 
infd= _fileno( datfp ); 
if(infd <= 0) 

printf("bad name 1 "); 

inhdr.cols=pict_now.s_cols; 
inhdr.rows=pict_now. s_rows; 
inhdr.bpp=3; 

er_r=_write(infd, (void *)(&inhdr), sizeof(PHDR)); 
for(y = 0; y < pict_now.s_rows; y++) 
{ 

#ifdef VIRTUAL 

V °1fT( f b U f3rT: r ( 1 void_.far -)_vload( pict.now.pictlyL.VM.CLEAN )) . 
NULL ) 

{_vheapterm();exit( -1 ); 
} 

#else 

void "buffer!; 

buf fer1 = (void •) pict_now.pict[y]; 
er _r=_write(infd, bufferl, sizeof(char)*pict_now.s_cols*3); 
} 

fclose(datfp); 

strcat(strcpy(name_of_fiie,name), .sgn ); 

datfp=fopen(name_of_file,'W); 
fprintf(datfp,"%s \n 0 0\n",name); 
fDrintf(datfp,"%d O\n",pict_now.s_cols-1 ); 
fprintf(datfp,"%d %d \n",pict_now.s_cols-1 lP ict_no W .s.rows-1), 
fprintf(datfp," 0 %d\n",pict_now.s_rows-1); 



fclose(datfp); 
} 

//========== 
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#include <graph.h> 
#include <std!ib.h> 
#include <iostream.h> 
#include "prqjcta 8 -* 1 " 

// For Constructor Calculate ratio of Lengthes. 

// FOR CONSTRUCTOR Fill Members 
//88888888888 

LINE PROJECTION :: LINE_PROJECTION 

" (DIR_LINE 11 , PT p, DIR.LINE pr, PT p_pr) 
{ double P, Ro; 
RM1; 
Prj=pn 

P = H.RATIO_for_PT( p); 
Ro= pr.RATIO_for_PT( p_pr); 
if (P && (1-Ro)) 

{proi_prm=(Ro-P)/(P*(1-Ro));return;}; 
cout « "LINE UNRESOLVABLE\n"; 
} 

PT cross_line(DIR_LINE Linel , DIR_LINE Line2) 
{PT out; 
double det; 
*rf(det=Line1.a*Line2.b-Line2.a*Line1.b) 

{out.u=(Line1 .b*Line2.c-Line1 .c*Line2.b)/det; 
out.v=(Line1 .cTJne2.a-Line2.c*Line1 .a)/det; 
} 

else out.u=out.v=0; 
#ifdef DEBUG 
_setcolor(0); 

_ellipse(_GFILLINTERlOR, (short) (outu-1), (short) (out.v-1). 
(short) (out.u+1),(short) (out.v+1)); 

#endif 

return out; 
} 

// Bield real space line connecting points X1 and X2 

/// X1 belongs to linel, X2 to Iine2: 

// PT pr1 - projection X1 

// PT pr2 - projection X2 

// LINE PROJECTION linel, line2 

DIR LINE Line for PT_pr(LINE_PROJECTION linel, PT pr1, 
~ ~ ~ LINE_PROJECTION Iine2, PT pr2) 

{ 

double P.Ro; 
PTp1,p2; 
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Ro=line1 .Prj.RATIO_for_PT( prl ); //relative point position at line 
P=line1.P_for_Ro( Ro); 

p1=line1.RI.PT_for_P(P); . * ■»■ tina 

Ro=line2Prj.RATIO_for_PT( pr2); //relative point position at line 

P=line2.P_for_Ro( Ro); 

p2=line2.RI.PT_for_P(P); 
DIR_UNE In(p1 ,p2); 
return(ln); 

// Bield projection line connecting points p1 and p2 

/// p1 belongs to linel , p2 to Iine2: 

// PT p1 - projection X1 

// PT p2 - projection X2 

// LINE_PROJECTION linel, Iine2 

DIR LINE Line for PT_rl(LINE_PROJECTION linel, PT p1, 
LINE_PROJECT10N Iine2, PT p2) 



{double P.Ro; 
PTp1pr,p2pr; 

P=line1 .Rl. RATIO_for_PT( p1 ); //relative point position at line 

Ro=line1.Ro_for_P( P); 

p1pr=line1.Prj.PT_for_P(Ro); 

P=line2.RI. RATlO_for_PT( p2); //relative point position at line 

Ro=line2.Ro_for_P( P)r 

p2pr=line2.Prj.PT_for_P(Ro); 
DlR_LINEIn(p1pr,p2pr); 
return(ln); 
} 

//===== == _ 

//============================-=-= =— 



// =1 if point P in quagrangle . 
int INside(DIR_LINE I1,DIR_LINE I2,DIR_LINE I3,DIR_LINE I4,.nt col.int row) 
{retum(H.Left_Right(col,row)&&l2.Left_Right(col,row)&& 
l3.Left_Right(col,row)&&l4.Left_Right(col,row)); 

} == 

//=========================== = 

int U_dist(DIR_LINE I) 

{return (l.end_pnt.u- l.st_pnt.u) ; 

} ======== 
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#include <stdlib.h> 
#include <vmemory.h> 
#include ,, res_mch8.h" 
#define AVERAGE 
#define SMOOSEJNT 1 

extern double GAMMA; 
//================== 



COLORVEC (*PointColorFunct(short M))(COLOR_RGB p1, double 
Thresh_mdl) 

{ switch ( M) 

{case NTSC:retum(coIor_space_NTSC); 
case New_plan:return(color_space_NEW); 
case HSI:return(color_space_RGB); 
case RGB:retum(color_space_RGB_simple); 
case LUMIN_THR:return(color_space_LUMIN_THR); 
case IHS:return(color_space_IHS); 

}; 

return NULL; 
} 

//================================ 

void GRAPH_OUT(int ex)- 

idisplaycursor( _GCURSORON ); 
_setvideomode( _DEFAULTMODE ); 
if (ex) exit (ex); 

> _ __ _ - 

//========================================--=-=-—= 



int GRAPHICS_START( struct _videoconfig *p_vc,short GR_mode) 

^ _displaycursor( _GCURSOROFF ); 
_setvideomode( GR_mode ); 

if(_grstatus( ) <0) return(1); 

_getvideoconfig( p_vc ); 

make_palette(); 
return 0; 

// ■ sorting vertexes 

int cdecl c_comp( const void *elem1 , const void *elem2) 

{ if (((SCR_PNT*)elem1 )->c >((SCR_PNT *) elem2)->c) 
return 1 ; 

else 

if(((SCR_PNT *) eleml )->c < ((SCR_PNT -)eiem2)->c) 
1H 
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return -1 ; 
else return 0; 

} 

void match_vertex(SCR_PNT *v) 
{ SCR_PNT vrt[4]; 
int i; 

for(i=0;i<4;i++) 
vrt[i]=*(v+i); 

qsort((void *) vrt,4,sizeof(SCR_PNT),c_comp); 
if(vrt[0].r< vrt[1].r) 

{*(v+3)=vrt[u];*(v+2)=vrt[1 ];} 
else 

nv+3)=vrt[1]; -(v+2)=vrt[0];} 
if(vrt[2].r < vrt[3].r) 

{*v=vrt[2];*(v+1)=vrt[3];} 
else 

{*v=vrt[3]; -(v+1)=vrt[2];} 

} = _ === __ = _ = _ =========== ==================== 

inline short interpol(short * s.double x,double y) 

{double r=s[O] + xY(s[0]-s[1 ]+s[2]-s[3])+x-(s[1 ]-s[0])+y*(s[3]-sf0]), 

retum((short)r); 

}_ _ ====== _ = — =-=-=========================== 



// ONLY FOR INTER_pix_color_rgb 
// and INTER_pix_color_rgb_median 
//===========================— 



inhne~COLOR_RGB B E_l inear( C O LO R_RGB *p,double xjract.double 
y_fract) 

// loop over coolr 

{short s[4]; 

COLOR_RGB out_col; 
s[0]=p[0].r; 
s[1]=p[1]-r; 
s[2]=p[2].r; 
s[3]=p[3].r; 

out_col.r=(short) interpol(s,x_fract,y_fract); 

s[0]=p[0].g; 

s[1]=p[1]-g; 

s[2]=p[2].g; . 

s[3]=p[3].g; 
out_col.g=(short) interpol(s,x_fract,y_fract); 

s[0]=p[0].b; 

s[1]=p[1]-b; 

s[2]=p[2].b; 

s[3]=p[3].b; 

ns 
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out_col.b=(short) interpol(s,x_fract,y_fract); 
return out_col; 

} === 

//================== = 



COLOR.RGB INTER_pix_color_rgb(PCTp1, PT PT_now) 

{ jnt colO=(int)PT_now.u, 
- rowO=(int)PT_now.v; 
double x_fract=PT_now.u-colO, y_fract=PT_now.v-rowO; 
. COLOR.RGB p[4]; 
p[0]=p1 .get_pixel(rowO,co!0); 
p[1]=p1.get_next(); 
p[3]=p1 .get_pixel(row0+1 ,col0); 
p[2]=p1 .get_next(); 

return ( BE_linear( p, x_fract, y_fract)); 

} ================= ======================== 

COLOR_RGB INTER_pix_color_rgb_median(PCT p1, PT PT_now) 
{ 

int colO=(int)PT_now.u, 
rowO=(int)PT_now.v; 
double x_fract=PT_now.u-colO, y_fract=PT_now.v-rowO; 
COLOR.RGB p[4]; 

p[0]=p1.get_median_pixel(row0,col0,SM0OSE_INT); 
p[1]=p1.get_median_pixel(row0,col0+1,SMOOSE_INT); 
p[2]=p1 .get_median_pixel(row0+1 ,col0+1,SMOOSE_INT); 
p[3]=p1 .get_median_pixel(row0+1 ,col0,SMOOSEJNT); 

return ( BE_linear( p, x_fract, y_fract)); 

} 



#define NTSCr(c) ((c).r*0.6-(c).g*0.28-(c).b*0.32) 
^define NTSCg(c) (0.2r(c).r-0.52-(c).g+0.31*(c).b) 

#define NTSCw(c) (0.3-(c).r+0.59*(c).g+0.11*(c).b) ^ 

//=================================--=-==—=== 

COLOR VEC color_space_NTSC(COLOR_RGB p1. double Thresh_mdl) 
{COLOR_VEC out={0,0,0}; 

if((out.c[0]= NTSCw(p1 ))>Thresh_mdl) 
{out.c[1]= NTSCr(pl); 
out.c[2]=NTSCg(p1); 
} 

out.c[0]*=0.6; 
return out; 
} 

lb 
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#define RGBr(c) (c).r 
#define RGBg(c) (c).g 
#define RGBw(c) ((c).r+(c).g+(c).b) 



//=============== 

COLOR VEC color_space_RGB(COLOR_RGB p1, double Thresh.mdl) 
{COLOR_VEC out={0.°.°}: 

if((out.c[0]= RGBw(p1 ))>Thresh_mdl) 
{out.c[1]= RGBr(p1)/outc[0]; 
out.c[2]= RGBg(p1)/out.c[0]; 

out.c[0]*=0.33333333333333333*GAMMA; 
return out; 

} =-=-=-============ 

//========================= 



COLOR VEC color_space_LUM(COLOR_RGB p1, double Threshmdl) 

{COLO oYc^=°o^^^^ 
return out; 



} 



#define RGBSr(c) (c).r 
#defme RGBSg(c) (c).g 
#define RGBSw(c) (c).b 



COLOR.VEC color_space_RGB_simple(COLOR_RGB p1, double 
Thresh_mdl) 

{COLOR_VEC out={0.0,0}; 

out c[0]= (RGBSr(p1)>Thresh_mdl)?RGBSr(p1):0; 
out c[1}= (RGBSg(p1)>Thresh_mdl)?RGBSg(p1):0; 
out.c[2]= (RGBSw(p1 )>Thresh_mdl)?RGBSw(p1 ):0; 
return out; 

} ================================== 

//"#define NEWr(c) (0.4*((c).r+(c).g)-(c).b) 
// For interval normalisation 0.4 ->0.5 
#define NEWr(c) (0.5*((c).r+(c).g)-(c).b) 
#define NEWg(c) ((c).r-(c).g) 
#define NEWw(c) ((c).r+(c).g+(c).b) 
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COLOR.VEC color_space_NEW(COLOR_RGB p1, double Thresh_mdl) 
{COLOR_VEC out={0,0,0}; 

if((out.c[0]= NEWw(p1 ))>Thresh_mdl) 

outc[1]=NEWr(p1); 

out.c[2]= NEWg(p1); 
II O ut.c[1]=NEWr(p1)/out.c[0]; 
// out.c[2]=NEWg(p1)/outc[0]; 

oulc[0]*=0.6666666666666666; 
return out; 

} _ _ =—=-==-=-==== 

//=======================—=-=== 



#define LMNr(c) (c).r 
#define LMNg(c) (c).g 

#def.ne LMNw(c) (((c).r+(c).g+(c).b)*0.33333333333) 
#define Thresh_LUMINEN 136 



COLOR_VEC color_space_LUMIN_THR(COLOR_RGB p1, double 
Thresh_mdl) 

{COLOR_VEC out={0,0,0}; 
double t; 

out.c[2]=out.c[1]=out.c[0]= ((t=LMNw(p1 ))>Thresh_mdl)?t:0; 
return out; 

} f == _ ================ =========================== 

const double SQ3= (sqrt(3.0)); 
const double PI05=(asin(1 .0)); 

#define min3(c) (_min((c).r min((c).g,(c).b))) 

#define max3(c) (_max((c).r, max((c).g,(c).b))) 

#define IHSh(c.d) (atan (SQ3-((c).g-(c).b)/d» 
#def.ne IHSi(c) (((c).r+(c).g+(c).b)*0.33333333333) 
#define IHSs(c) ((double)(max3(c)-min3(c))/(douWeXm^^ 
//=================================== =~= : 

COLOR VEC color_space_IHS(COLOR_RGB p1 , double Thresh_rndl) 
{COLORIvEC out=To,0,0}; 
double r=2*p1.r-p1.g-p1-b; 

out.c[1]=IHSi(p1); 
• outx[2}=out.c[1]?IHSs(p1):0; 
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if(fabs(out.c[2])<Thresh_mdl) 
out.c[0]=0; 

e out.c[0]=r?IHSh(p1,r):(((p1.g-p1.b)<0)?-PI05:PI05); 

return out; 
} 
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#include <stdlib.h> 
#include <stdio.h> 
#include <vmemory.h> 
#inc!ude<malloc.h> 

unsigned char _far ~ virtalloc(short xdim.short ydim) { 
int y j; 

unsigned char far mem; 

mem = (unsigned char _fer~) malloc( ydim * sizeof(unsigned char 
_far~)); 

if(mem == NULL) 
return(NULL); 

forty = 0: y < ydim; y++) { ri ^ . 

if ( (mem[y] = (unsigned char__far-) malloc(xdim*sizeof(char) )) — 

NULL) 

{ printf("NO MEMORY MAX size= %d",y); 
forO=0;j<yj-H-) 

free((void *)mem[j]); 
free((void")mem); 
return(NULL); 

} 

} 

return(mem); 

} 
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ORIGIN = PWB 
ORIGIN_VER = 2.0 
PROJ = LNS_CORR 
PROJFILE = LNS_CORR-MAK 
BUILDDIR = obj 
DEBUG = 0 

BRFLAGS = /o obj\$(PROJ).bsc 
BSCMAKE =bscmake 
SBRPACK = sbrpack 
NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
BROWSE = 1 

CC =cl . „ 

CFLAGSJ3 = A/V2 /BATCH /FR$*.sbr /Zn 
CFLAGS_D = /f/Zi/Od 
CFLAGS.R = /f-/0t/0i/OI/Oe/0g/Gs 

CXXFLAGS G = /AL AA/4 /G2 /D_DOS /BATCH /FR$*.sbr /Zn 
ryyFi AttS~D = /f- /Od /FPi87 /Zi /DMICI /DSINGLE_WIN 
SSfKgIIr = J- /Ot /O. /Og /Oe /Oi /FPi87 /Gs /DMICI /DSINGLE.WIN 
MAPFILE_D = NUL 

LR^GSjG R =~/NOI~/STACK:32000 /BATCH /ONERROR:NOEXE 

LFLAGS_D = /CO /FAR /PACKC 

LFLAGS.R = /EXE /FAR /PACKC 

LINKER = link 

ILINK = ilink 

LRF = echo > NUL 

ILFLAGS =/a/e 

LLlBS_G = graphics later 

CVFLAGS =/25/S 

RUNFLAGS = ..\win4\S160_0 ..\win4\S160_ autol 

FILES = LNS CORR.CPP .ALIBWICALLOC.CPP ..\LIB\PROJCTN7.CPP\ 
..\LIB\PTC_M7.CPP ..\LIB\RES_MCH7.CPP COR.FNC.CPP 

OB^S^'ob^LNS.CORR.obj objWICALLOC.obj obj\PROJCTN7.obj 

0bjAPIC cl^RES A MCH7.obj obj\COR_FNC.obj obj\COR_WIN.obj 
SBRS = obj\LNS_CORR-sbr objWICALLOC.sbr obj\PR0JCTN7.sbr 

° bjXPIC obARES^MCH7.sbr obj\COR_FNC.sbr obj\COR_WIN.sbr 
all: obj\S(PROJ).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .obj .sbr.cpp 
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obi\LNS CORR.obj : LNS.CORR.CPP C:\C700\INCLUDE\stdlib.h\ 
C~\C700\lNCLUDE\conio.h C:\C700\INCLUDE\stdio.h\ 
C : \C700\INCLUDE\string.h C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\float.H C:\C700\INCLUDE\io.h 

C\C700\!NCLUDE\time.h\ 

C-\C700\INCLUDE\ctype.h C:\C700\INCLUDE\iostream.h\ 
C:\C700\MFC\INCLUDE\afx. h LNS_C0RR.h cor_win.h 

c:\i1ya\lib\vicalloch\ 

C-\C700\INCLUDE\ios.h C:\C700\lNCLUDE\streamb.h\ 
C : \C700VINCLUDBistream.h C:\C700\INCLUDBostream.h\ 
C\C700\MFC\INCLUDE\afx.inl ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
..\L!B\res_mch7.h c:\iiya\lib\lin_trn7.h C:\C700\INCLUDEWmemory.h\ 
C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c S(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\LNS_CORR.obj LNS_CORR.CPP 
!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\LNS_CORR.obj LNS_CORR.CPP 
!ENDIF 

obj\LNS_CORR.sbr : LNS.CORR.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\conio.h C:\C700\INCLUDE\stdio.h\ 
C:\C700\INCLUDE\string.h C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\float.H C:\C700\INCLUDE\io.h 

C:\C700\INCLUDE\time.h\ 

C:\C700\INCLUDE\ctype.h C:\C700\INCLUDE\iostream.h\ 
C:\C700\MFC\INCLUDE\afx.h LNS_CORR.h cor_win.h 

c:\ilya\lib\vicalloc.h\ 

C:\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 

C:\C700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 

C \C700\MFC\INCLUDE\afx.inl ..\LlB\projctn7.h ..\LlB\pic_mch7.h\ 

.AL!B\res_mch7.h c:\ilya\lib\Iin_trn7.h C:\C700\INCLUDE\vmemory.h\ 

C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

OS $(CXXFLAGS_G) 

$(CXXFLAGSJD) /FRobj\LNS_CORR.sbr LNS_CORR.CPP 
!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\LNS_CORR.sbr LNS_CORR.CPP 
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IENDIF 



ob.WICALLOC.obj : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDBstdio.h C:\C700\INCLUDEWmemory.h\ 
C:\C700\INCLUDE\malloc.h 

!IF$(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 

'ELSE 

@$(CXX) @«obj\$(PROJ).rsp 



ob.WICALLOC.sbr : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDEWmemory.h\ 
C:\C700\INCLUDE\malloch 

!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 

^C^F^G^KFR°b]WICALLOC.sbr.ALIB\VICALL0C.^ 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS G) 

$(CXXFLAGS_R) /FRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

IENDIF 

ob]\PROJCTN7.obj : „\LlB\PROJCTN7.CPP C:\C70D\INCLUDE\graph.h\ 
CAC700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 

.ALlB\projctn7.h\ 

C \C70Q\lNCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
CAC700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
CAC700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\S(PROJ).rsp 

$(C)C^^DT?oobj^ROJCTW.f^ 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
$(C)O^^Rl^oobjVROJCTN7.obj..\LIB\PROJCTN7.CPP 

IENDIF 
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obi\PROJCTN7.sbr : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 
\LIB\projctn7.h\ 

C-\C700\lNCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 
C:\C700\I N C LU DEXmath. h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^)Off^^S"7FRobj\PROJCTN7.sbr..\LIB\PROJCTN7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\PROJCTN7.sbr ..\LIB\PR0JCTN7.CPP 
iENDIF 

obj\PIC_M7.obj : ..\LIB\PIC_M7.CPP C:\C700\INCLUDBstdlib.h\ 
C:\C700\lNCLUDBstdio.h C:\C700\INCLUDE\graph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDE\io.h C:\C700\INCLUDE\fcntl.h 

C:\C700\IN CLU D E\string.h\ 

C:\C700\INCLUDE\floatH C:\C700\INCLUDE\malloch ..\LIB\phdr.h\ 
c:\iiya\Iib\vicalloch..\LIB\pic_mch7.h C:\C700\INCLUDEWmemory.h\ 
..\LIB\projctn7.h 

!IF $(DEBUG) 

@$(CXX) @«obJ\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FoobjAPIC_M7.obj ..\L1B\PIC_M7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
Jc $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PIC_M7.obj „\LIB\PIC_M7.CPP 
iENDIF 

obj\PlC_M7.sbr : ..\LIB\PIC_M7.CPP C:\C700\INCLUDBstdlib.h\ 
C:\C700\INCLUDEVstdio.h C:\C700\INCLUDBgraph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDE\io.h C:\C700\INCLUDE\fcntl.h 

C:\C700\INCLUDE\string.h\ 

C:\C700\INCLUDBfloat.H C:\C700\INCLUDE\malloc.h ..\LIB\phdr.h\ 
c:\ilya\lib\vicalloch ..\LIB\pic_mch7.h C:\C700\INCLUDEWmemory.h\ 
..\LIB\projctn7.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
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« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IENDIF 



klDC5 MrH7 ohi . \. iR\RES MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
^l^^i^SS^M - MJB\plc.mch7.h ..\LIB\res mdi7.h\ 

CAC700MNCLUDBgraph.h y .\LIB\projctn7.h C:VC700UNCLUDBmath.h 



!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 



« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
$ C (C&^gT^ 
IENDIF 

obj\RES MCH7.sbr: ..\LIB\RES_MCH7.CPP C:\C700\INCLUDBstdlib.h\ 
CAC700\INCLUDE\vmemory.h ..\LIB\pic_mch7.h AL IBVes 
C:\C700\INCLUDE\graph.h ..\LIB\projctn7.h CAC700\lNCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^GS^7FRobj\RES_MCH7.sbr .ALIB\RES_MCH7.CPP 
IELSE 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^G^l7FRobj\RES_MCH7.sbr .ALIB\RES_MCH7.CPP 
« 

IENDIF 

cbj\COR_FNC.obj : COR.FNC.CPP C:\C700\INCLUDE\stdio.h 

CAC700\INCLUDE\stdIib.h\ 

CAC700\INCLUDE\conio.hCAC700\!NCLUDE\float.H\ 

CAC700\INCLUDE\graph.h corjnc.h ..\LlB\pic_mch7.h 

..\LIB\res_mch7.h\ . 

CAC700\INCLUDE\vmemory.h ..\LIB\projctn7.n 
CAC700\INCLUDE\math.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
85 
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^(CJO^G^DJ^oobjACOR.FNC.objCOR.FNC.CPP 
« 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

$(C5^G^R)^oobjU:OR_FNC.objCOR^FNC.CPP 
« 

IENDIF 

objACOR.FNC.sbr : COR.FNCCPP C:\C700\INCLUDE\stdio.h 

C-\C700\INCLUDE\stdiib.h\ 

C \C700\INCLUDE\conio.h C:\C700\INCLUDE\float.H\ 
C:\C700\INCLUDE\graph.h corjnc.h ..\LIB\pic_mch7.h 

..\L!B\res_mch7.h\ . 

C:\C700\INCLUDE\vmemory.h ..\LIB\projctn7.h 

C:\C700\INCLUDE\math.h 
!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) riio 
$(CXXFLAGS_D) /FRobj\COR_FN C . sbr COR_FNC.CPP 
« 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\COR_FNC.sbr COR.FNC.CPP 
« 

IENDIF 

obi\COR_WIN.obj : COR WIN.CPP C:\C700\INCLUDE\vmernory.h\ 
C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stdlib.h\ 
C \C700\INCLUDE\conio.h C:\C700\INCLUDE\malloch\ 
C \C700\lNCLUDE\fioat.H C:\C700\INCLUDE\graph.h\ 
C:\C700\iNCLUDE\string.h LNS_CORR.h cor_fnc.h ..\LIB\projctn7.h\ 
.ALIB\pic_mch7.h ..\LIB\res_mch7.h c:\ilya\lib\lin_trn7.h\ 
C:\C700\I N CLUDE\math.h 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFU\GS_D) /Foobj\COR_WIN.obj COR_WIN.CPP 
!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) _ 
$(CXXFLAGS_R) /Foobj\COR_WIN.obj COR_WIN.CPP 

IENDIF 

obj\COR_WIN.sbr : COR_WIN.CPP C:\C700\INCLUDE\vmemory.h\ 
Bb 
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C \C700\INCLUDE\stdio.h C:\C700\INCLUpE\stdl.b.h\ 
C : \C700\INCLUDBconio.h C:\C700\INCLUDE\malloch\ 
CAC700\INCLUDE\float.H C:\C700^CLUDE\graph.h\ 
C \C700\INCLUDE\string.h LNS_CORR.h cor fnc.h \L B\projctn7.h\ 
..VLIB\pic_mch7.h ..\LIB\res_mch7.h c:\ilya\l.b\l.n_tm7.h\ 
C:\C700\INCLUDE\math.h 



i|F $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 



^SS3^lFRabjCO^WIN.*r COR_W.N.CPP 
« 

'ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
S!J^tj5lFR^OFUWIN.*r COR.WIN.CPP 



IENDIF 



obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 
« 

obj\$(PROJ).exe : $(OBJS) 

^$(NMAKEBSC2) ^NMFLAGSM S(PROJFILE) ob|\$(PROJ).bsc 

!IF $(DEBUG) 

$(LRF) @«obj\$(PROJ).lrf 
$(RT_OBJS: = +* 
) $(OBJS: = +* 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: = + A 
) + 

$(LLIBS_G: = + A 
$(LL!BS_D: = + A 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_D); 
<< 

IELSE 

$(LRF) @«obj\S(PROJ).lrf 
$(RT_OBJS: = + A 
) $(OBJS: = +a • 
) 

$@ 

$(MAPFILE_R) 
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$(LIBS: = + A 

$(LLIBS_G: = + A 
) + 

$(LLIBS_R: = + A 

$(DEF_F1LE) $(LFLAGS_G) $(LFLAGS_R); 
« 

1ENDIF 

S(LINKER) @obj\$(PROJ).lrf 



.cpp.obj : 

!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_D) /Fo$@ $< 
« 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_R) /Fo$@ $< 
« 

1ENDIF 

.cpp.sbr : 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
$(CXXFLAGS_D) /FR$@ $< 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FR$@ $< 

1ENDIF 



run: obj\S(PROJ).exe 

obj\$(PROJ).exe S(RUNFLAGS) 

debug: obj\$(PROJ).exe 

CV $(CVFLAGS) obj\S(PROJ).exe $(RUNFLAGS) 
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void corr win>oto(PCT win.source.PCT "Wo ^CR ™T win.size 
_ _^ wjn _ step doub ,e CORR.THRESH, 

i short *StripEnds) ; 
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„ Module ca 1CU ,a,es Nation ^*°™«™ 0 J^£**£n6 e s 
II [path]&RRW_P.rgb 



// 



// Where _ ^ Qf d]Teciory] 

o . first letter of file name 
{{ RR -^gits«n-e^ 

// " 

// w 
MAKEPRB 
// 
// 



(RR= 161 32 | 48 | 64) 
- number corresponding to window number (see 

n description. 

// first not existing number. 
// COMMAND STRING 

"ll lns_corr <PROTO_1_Name> <MASK> [CommandFile} 

",, <PROTO_1_Name> File name of PROTOTYPE without 

r^^MAS^ Mask for prototypes FileNames without extention 

and 

a Prototype s number. 

I, [CommandFile] Optional ASCI file with a run t.me parameters. 
// 

// ^TgB files of prototypes and corresponding .SGN files created by 
// module MAKEPRB. 
// RUN TIME parameters: 

/, 0 00 0 -shift for all cases have to be 0 

// <CalorSpa ^ have used 1 . as worked only with a luminance 

// <Window width> 

II We have used 8 

//SEE ALSO FILE "LNS_CORR.INI" 

"l ^Correlation functions in PROT0.1 .DBC file. 



#include <stdiib.h> 
#include <conio.h> 
#include <stdio.h> 
#include <string.h> 
#include <graph.h> 
#include <float.H> 
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#include <io.h> 
#include <time.h> 
#include <ctype.h> 
#include <iostream.h> 
#include <afx.h> 
#include "LNS_CORR.h" 
#inciude "cor_win2.h" 
#inciude "vicalloc.h" 



char f_name[40]="_".FH-E-n ame t 4 °l- - ' FRAME_Name[40]="J'. 
ARGV STRING'narne[401="_". SIGN_name[40]="_".TAG_name[9]=V'. 
drive[3]="_",dir[30]= ,, J'. 

ext[5]=" ",*tag_frame; 
double GAMMA=1..0,CORR_THRESH=0.0,Thresh_mdl=0.0; 

short MAP; 

short V0ITING=3,TAG_hight; 

struct _videoconfig vc; 

FILE'datres; 

int FLG - WRIGHT=0; 

double sh[4J={0, 0,0,0}; 

PCT pict_target, pict_proto; 
FILE *out_rslt; 

int picture inf(char *name,SCR_PNT *vertexes); 

int picture inf num(char -name.SCR.PNT *vertexes shortn); 

int get number*); // INITIALISATION GRAPHICMODE, GET SCALE 

int gef number 3(); // INITIALISATION GRAPHICMODE GET SCALE 

void oSLshifUfFILE f .double - sh); // INITIALISATION GRAPHICMODE, 

pr-r SCALE 

void get shift(double *sh); // INITIALISATION GRAPHICMODE, GETSCALE 
int get_number_3_f(FILE *f); // INITIALISATION GRAPHICMODE, GET 

impure inf_num 2(char*name,SCR_PNT ^ertexes.short n char-ext); 
int Dicture'inf num~new(char -name,SCR_PNT -vertexes.short n), 

$$$$$$ss$$$$$$$$$$ 

short PRESENT_HIGHT=32, CALC_HIGHT =32; 

FILE * INP_PROTOCOL; 
FILE "PROTOCOL; 

CString PROTOCOL_NAME; 
CString PROTOCOL_START; 
CString PROT01_HEADER=CString::CStnng( 
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..pROTO.File\tFRAME_NameUSTRING_nameMS_nameUSLengthXtWinLengt 
hAtSPACBn"); 



//= 



void init_protocol(char "name) 

{ FLG= F a2ess(PROTOCOL_NAME,0);//0 ( if exist 
PROTOCOL=fopen(PROTOCOL_NAME, a ); 

if Tp L rSif(PROTOCOL,"AUTO and CROSS correlation functions \n %s». 

PROT01_HEADER); 
PROTOCOL_START=name; 
PROTOCOL_START+="\t M ; 

} ====================== 

//=================== 



int open_inp_prot(char *name) 
{if(!(INP_PROTOCOL=fopen(name 1 "r"») return l; 



//split first str 
fscanf(INP_PROTOCOb,"%T\n]s"); 

return 0; 

} 



$$$$$$$$$$$$$$$$$35$$ . .= - u f.,0 exiS f 

//return file name without extwntion in "name" and TRUE 1 rf file exist, 
int nextpict(char *name,char -mask,char *ext,int num) 
//if num=-2 initalisation; 



// -1 next 
// >0 adding this # to mask 
// NULL if notexist file with ".rgb" 



{static int now; 
char full_name[80]; 
strcpy(name,mask)", 
if (num==-2)now=0; 
else if (num==-1 ) 

now++; 
else if (nurnO) return 1; 
else now=num; 

_itoa( now, name+strlen(name), 10); 
strcat(strcpy(f ul l_name , name), ext); 

//1 if file exist 
return(!_access( full_name, 0 )); 

} ================= 
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#include <fstream.h> 
int ReadStrinf(char •name.short *StD) 
{'rfstream InpF; 
char a[80]; 

strcat(strcpy(a,name),".str"); 
short i; 

lnpF.open(a,ios::in|ios::nocreate); 
if(lnpF.fail()) 
{InpF.clear(O); 
return 1; 
} 

InpF.getlinefa.BO/Xn'); 
InpF.getline^a.SO.'Xn'); 
InpF.getlineja.SO.'Xn'); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,80,'\n'); 
i=0; 
do 
{ 

lnpF»StD[i++]; 
if (inpF.eof()|| i>17) 

{StDHl=-1; 

break; 

} 

lnpF»StD[i++]; 
} 

while(1); 
lnpF.close(); 
return 0; 

} 

SCR_PNT winsize; 



int main(int argc.char* argvQ) 

{int FLG_F=0, FLG_WR1GHT=0; 

FILE 'datainf; 

short winstep, map_stnd; 

short n=0; 

SCR_PNT t_pos; 

if((argc != 3) && (argc !=4)) 

printf(" target-file proto_file__mask \n">; 
FLG_F=0; 
retum(1 ); 

} 
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else 
if(argc ==4) 
{FLG_F=1; 

if(!(datainf=fopen(argv[3],"r"))) return 0; 
} 

if(FLG_F) 

{get_shift_f(datainf,sh); // GET SCALE 
get_number_3_f(datainf); // GET SCALE 

} 

else 

{get_shift(sh); // GET SCALE 0 
get_number_3(); 

> 

strcpy(ARGV_1 ,argv[1 ]); 
PROTOC0L_NAME=argv[1]; 
PROTOC0L_NAME+= M .dbc"; 
init_protocol(argv[1 ]); 

// ================ GRAPHICS START 

if(GRAPHICS_START(&vc, GRAPHMODE)) exit(-1 ); 
//========= TARGET PICTURE name and vertexes 

SCR_PNT target_pos; // CONSTRACTOR default 0,0 
short StrDescr[17]; 
_splitpath{ argvfl], drive,dir,TAG_name I ext ); 
pict_target=sign_storage_rgb(argv[1],vc ); 
if(ReadStrlnf(argv[1 ],StrDescr)) 

{printf("STR PROTO not exist"); GRAPH_OUT(-1 );retum -1; 



winsize.r=pict_target.s_rows; 
winstep=winsize.c; 

//"PROTO_File\tFRAME_Name\tSTRING_name\tS name\SLength\tWinLengt 
h\tSPACE\n"); 

fprintf(PROTOCOL,"%s %8s\t%6s\t%12s\t%4d\t%4d\t%12s\n%s", 
(const char 

*)PROTOCOL_START,FRAME_Name,STRING_name I SIGN_name, 
pict_target.s_cols,winsize.c,SP[MAP], 
(const char *) P ROTO_TAG_H EAD E R) ; 

//========= PROTOTYPE LOOP OVER names 

char proto_name[NAME_LENGTH],buff[4]; 
SCR_PNT proto_pos,z; 
//loop over masks 

//return file name without extention in "name" and TRUE 1 ff file exist; 
short proto_number=0; .//# 0; 

while( next_pict( proto^ame.argvpj/'.rgb", proto_number)) 

{ proto_number=-1 ; //next; 
SCR_PNT pr_v[4]; 
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// PROTO INFORMATION IN PROTOCOL 

// •TAG"File"tFRAME_Name\tSTRING_name\tS_Name\tLegnth\n ) 

fprintf(PROTOCOL." %12s\t %8s\t %6s\t %12s\t%4d\n", 
proto_name,FRAME_Name 1 STRING_name.SIGN_name lP ict_proto.s_cols); 

TAG_hight=pict_proto.s_rows; 
//TARGET PRESENTATION 

_clearscreen(_GCLEARSCREEN); 

proto_pos.c=target_pos.c=10; 

proto_pos.r=(target_pos.r=10) + pict_target.s_rows+5, 

sign_present_RGB( pict_target,target_pos); 

sign^resent.RGBCpirtjrotopro^pos); 
//==============================--— 

corr win proto(pict_target, pict_proto. 

" winsize, winste Pl CORR_THRESH,StrDescr); 

pict_proto.free_PCT(); 

_dLplaycursor( _GCURSORON ); 

_setvideomode( _DEFAULTMODE ); 

pict_target.free_PCT(); 

fclose(PROTOCOL); 

return(O); 

} 



// 



void geCshift_f(FILE f.double - sh) // INITIALISATION GRAPHICMODE, 
GET SCALE 
{int i; 

for(i=0;i<4; i++) 

{ fscanf(f,"%lf %inn",sh+i++,sh+i); 
} 

} 

// 



void"g = eLshift(double * sh) // INITIALISATION GRAPHICMODE. GET SCALE 

{ ' nt cout« "vertexes shift over rows ( top_right, bottom_right, bottomjeft. 
topjeft %\n"; 

for (i=0;i<4; i++) 
cin»sh[i]; 

} 

ci idctiti itp RHFET (RULE 26 v , 
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rn7grnumber_3() // INIT.ALISATION GRAPHICMODE, GET SCALE 

{ ' nt R 'displaycursor( _GCURSORON ); 

:setvideomode(.DEFAULTMODE);. NEW3 , RGBi4 _ 
cout « " [<0 EXIT], color_map (O-NTSC, 1-Hbi,2 ncvv.^od, 
LUMlN_THR 5-HSI\n"; 
cout«"WIN_SIZE\n "; 
cin »MAP»winsize.c; 

displaycursor( GCURSOROFF ); 
_setvideomode( GRAPHMODE ); 



_3_f(FILE *f) // INITIALISATION 

E 

{intR; 




PNT* 



if(!(datfp=fopen(new_name,"r")j) return 0; 
fscanf(datfp, ,, %s\n",new_name); 

i0 ^nK6Bt^r%<i %d\n",&(vertexes[n.c),&(vertexesn].r)); 
fclose(datfp); 
return 1 ; 

//========^=^=^"!! = ! = !]^^""!"-^^ = ===================== ; 

'^^^^^i^i^^l^R^ -vertexes.short n.char 

*ext=".sgn") 
{intij; 

char new_name[45]; 
FILE *datfp; 

strcat(strcpy(new_name .name), ext); 
if(i(datfp s fopen(new__name,"r"))) return 0; 

forG=0;j<n+1;j++) 
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^^(f^c^r^'c'datfp/^ci o/od\n".&(vertexes[i3.c),Sc(vertexes[i].r))==EOF) 
{fclose (datfp); return 0;} 
fclose(datfp); 
return 1; 

} = __ ======= - === =================================== = == 

rVoTd write_sign_inf(char -pr.PCT pict_now) 
{ char fl_fp[50],f_name[9]; 

. int FLG; 
FILE *dathere,*database; 
_splitpath< pr, drive, dir,f_name,ext ); 
strcat(strcpy(fl_fp,pr),".sgn"); 
dathere=fopen(fl_fp, , V); 

FLG=_access("PROTODB.r\ 0 );//-! if not exist 

jffKdatabase^openfTROTODB.I'V'a"))) 

{strcpy(fl_fp,"CAN NOT CREATE D_BASE FILE ); 

fprintf(damere } " WIN.name FILE.name FRAME_Name STRING_name 
SIGN_name\n "); , „ . _„ c Mt¥1 _ 

fprintf(dathere,"%8s %9s %10s %11s %9s \n",f_name, FILE_name, 

FRAME_Name,STRINGlname,SIGN_name); 

,f( ^rfntf(database, " WINname FILE.name FRAME_Name STRING_name 
SIGN name\n "); 

fprintf(database,"%8s %9s %10s %11s %9s \n",f_name, FILE.name, 

FRAME_Name,STRING_name,SIGN_name); 
fprintf(dathere,"%d 0\n",pict_now.s_cols-1 ); 
fprintf(dathere,"%d %d \n",pict_now.s_cols-1 ,pict_now.s_rows-1 ); 
fprintf(dathere," 0 %d\n",pict_now.s_rows-1); 
fprintf(dathere," 0 0\n"); 

fciose(dathere); 
fclose(database); 

n ======= =_=— ========================== 



(n't picture Jnf_num(char "name.SCR.PNT -vertexes, short n) 
{intij; 

char new__name[25]; 
FILE "datfp; 

strcaKstrcpytnew^ame.nameJ/'.sgn"); 
jf(!(datfp=fopen(new_name,"r"))) return 0; 
fscanf(datfp,"%s\n",new_name); 
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for(j=0;j<n+1 ;j++) 
f %°^f(datfp."%d o /od W, & (ve rt exesti].c), & (vertexe S[i ].r))==EOF) 
{fciose (datfp); return 0;} 
fclose(datfp); 
return 1 ; 

{S 5 ^^J^^^"«"»^ P ^ * vertexes ' short n) 

{int i,j; 

char new_str[80]; 
FILE *datfp; 

intr,FLG=0; n 
strcat(strcpy(new_str,name), .sgn ), 
if(!(datfp=fopen(new_str 1 "r"))) return 0; 
r=fscanf(datfp,"%[ A \n]s ",new_str); 
r=fscanf(datfp," %[ A \n]s ",new_str); 
Kcsynrf< (int)new:str[0]))//FILE INFORMATION ) 
y — 711 //(letter or underscore) 

{ sscanf(new_str," %s %s %s %s '\&FILE_name &FRAME Name, 
x v &STRING_name, &SIGN_name), 

i^fscanftdatfp," %[ A \n]s ",new_str); 
} 

forG=0;j<n+1 ;j++) 
for(i=0;i<4;i++) 

if(fscanf(datfp,"%[ A \n]s",new_str)==EOF) 
{fciose (datfp); return 0;} 

ss«Snf(new_str," %d %d",&(vertexes[i].c),&(vertexesin.r)); 

} 

fclose(datfp); 
return 1 ; 

} ================== 

//====================== 
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} 



TCOLOR VEC int_value_1(PCT w.double Thr, 

COLOR VEC rp_funct)(COLOR_RGB p1 .double 
Thresh_mdT) , AVE RAG E_VE C w_av) 
{COLOR_VEC col.sum[9][9],out,c1 ; 
const COLOR_VEC z={0,0,0}; 

short h_t,v_t,i,x,y,h I v, 
half_x=w.s_cols»1 ,half_y=w.s_rows»1 
quot_x=w.s_cols»2,quot_y=w.s_rows»2; 

long n; 

for(h=0;h<HOR_HARM+1 ;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 

sum[v][h].c[0]=sum[v][h].c[1 ]=sum[v][h].c[2]=0.0; 
n=w.s_cols*w.s_rows; 
n*=n; 

for(y=0;y<w.s_rows;y++) 
for(v=0;v<VERT_HARM+1 ;v++) 

{ 

v_t=y*((v+1)»1); 

vj=(v_t+(v & 0x0001 ? quot_y:0))/half_y; 
vj &= 0x0001; < 
for(x=0;x<w.s_cols;x++) 
{col=p_funct(w.get_pixel(y,x),Thr); 

d= sign_for_col(v_t,col); 

for(h=0;h<HOR_HARM+1 ;h++) 

{ 

h_t=x-((h+1)»1); 

h_t=(h_t+(h & 0x0001 ?quot_x:0))/half_x; 
h_t &= 0x0001 ; 
d = sign Jor_col(h_t, d ); 
for(i=0;i<3;i++) 
sum[v][h].c[i]+=c1.c[i]; 

} 

} 

} 

double s0,dd,max_v=0,th; 
for(dd=i=0;i<3;i++) 

{for(s0=h=0;h<HOR_HARM+1 ;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 
if(h||v) 

s0+=sum[v][h].c[i]*sum[v][h].c[i]; 

s0/=n; 

dd=w_av.var[i]+w_av.md[i] m w_av.md[i]; 

outc[i]=(dd?s0/dd:1); 

max_v=(max_v<out.c[i])?oLrt.c[i]:max_v, 

} 
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for(i=0;i<3;i++) 
fth=outcfi]/max_v; 
jl THRESHOLDING 

if(th<0.2) 
out.c[i]=0; 

} 

return out; 



},!==== 



ctLOR:^C(*PointColFunct())(COLOR_RGB p1 .double Threshmd.) 

{ switch ( MAP) KtTQrv 
{case NTSC:retum(color_space_NTSC) 
case New_plan:retum(color_space_NEW), 
case HSI:retum(color_space_RGB); 
case RGB:retum(color_space_RGB_s.mple ; 
case LUMIN_THR:retum(color_space_LUMIN_THR), 
case IHS:retum(color_space_IHS); 
>: 

return NULL; 

} =_=================== 

//===-,-;============= 



M nst7h"ort"cHlHIGHT_D=1 00, CH BASE D=47a 

CH_HIGHT=1 00, CH_BASE=450,jJQS=40,_ 

double scale_fact=1 ; _ =====; 



{ 

short i; 

char mess[40]; 

CO^Rji/EC rp_funct)(COLOR_RGB P 1 .double Thresh.mdl); 
p_funct=PointColFunct(); 

PCT win(win_size.c,win_size.r); 
PCT tag(win_size.c,win_size.r); 
SCR PNT st_t,st_win; 

AVERAGE VEC middle_win[64],middle_tag; 
const AVERAGE_VEC z={{0,0,0},{0,0,0}}; 

COLOR VEC *corr_now,cr, 
const COLOR.VEC z_col={0.0,0.0,0.0}; 
int line_size=win_source.s_cols+Proto.s_cots; 
//memory allocation 



loo 
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if((corr_now= (COLOR.VEC*) malloc( 
sizeof(COLOR_VEC)-(size_t)line_size-3))==NULL) 

{printf("WIN NOT MEMORY'); return;}; 

st_t.r=0; 
double dd; 

st_win.r=0; 
short k,FLG_COL=1; 
short StripStartStripStop; 
short PartNum; 
k=PartNum=0; 

while(StripEnds[PartNum]>=0) 

{StripStart=StripEnds[PartNum-M-]; 
StripStop=StripEnds[PartNum++]; 

for (st_win.c=StripStart; 
st_win.c+win_size.c<=StripStop;st_wm.c+=win_step,k++) 

{ 

FLG_COL=1; 
for(i=0; i<line_size;corr_now[i++]=z_col); 

win.load_template(win_source,st_win); 
middle_win[k]=average(win,Thresh_mdl,p_funct); 

#ifdef MICI 
#endif 

const COLOR_VEC z_UNIT={1 .0,1.0,1.0}; 

for (st_t.c=0;st_tc<=Proto.s_cols-win_size.c;st_t.c-M-) 

{ _ == __ 

//========================—===-= 

tag.load_template(Proto,st_t); 
middle_tag=average(tag,Thresh_mdl,p_funct); 

// DIFF ABS VALUES 

#,fdef nv _ 1( tag iW in,Thresh_mdl 1 z ^NIJjp ^nrt); 

strcpy(mess." VECTOR Approach to CORRELAT ON ); 
corrInow[sUx]=Correlation_single_1(cr,middleJag,middle_win[k],z 

UNIT); 

#ifd6f ^stTc^mess," DIFF ABS VALUES/ max ABS VALUES"); 

template_abs_diff_1 (tag.winThresh_mdl,zJJNIT,p__funct 1 
middle_tag,middle_win[k]); 

#else 

cr=template_conv_1 ( tag.win Jhresh_mdU_UNrr,pJunct); 
strcpyCmess," PEARSON CORR. "); 

con-_now[st_t.c]=Correlation(cr.middle_tag f rniddle_win[k],z_UNIT). 

#endif 
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// ONLY LUMINANCE 

// strcat(mess," ALL 3 COMP ); 

strcat(mess," Only 0 COMP"); 

corr_now[st_Lc].c[1]=corr_nowlst_Lc].c[2]- 

corr_now[st_t.c].c[0]; 

#ifdef MICI 

rn^fFl ( G.COL.CH_H,GHT_D,CH_BASE_D.CORR_THRESH. 

- 1 ~ st_tx,Proto.s_cols); 
FLG_COL=0; 
#endif 

} 

//S^TlL BE USED AS SEPARATOR FOR READING 

^ intf(PROTOCOL,"$\t% S \t$\t%4d\t ^ mess, st_w.n.c), 

for(i=0;i<Proto.s_cols;i++) //ONLY 0 COMP 

fprintf(PR0T0COL,"%6g\t",corr_now[i].c[0]) > 

fprintf(PROTOCOL," \n M ); 

} 

} 

win.free_PCT(); 
tag.free_PCT(); 
free({void *)corr_now); 
return ; 



void draw_chart(double *distjine, short n.double max_v 

short CH_HIGHT, 

short CH_BASE,double THRESH. 

short t_pos) 

{short 
double p, 
crit=max_value; 
if(!max_value) 
for (i=0;i<n;i++) 

crit=(dist_line[i]>crit)? distjine[i]:cnt; 
else crit=max_value; 
if(!crit) 
crit=1; 

p= CH HlGHT*(1-THRESH/cnt); 
_moveTo( 0,CH_BASE-CH_H1GHT ); . 

I09- 
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SBRS = objWITCHSTR.sbr objWICALLOC.sbr obj\PR0JCTN7.sbr 

° bjAL - T objAPICJVI7.sbr obj\RES_MCH7.sbr objAFILEMNP.sbr 
obj\MTCHTPl_2.sbr\ 

obj\COR_FNC2.sbr 

all: obj\$(PROJ).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .obj .sbr .cpp 

obj\MTCHSTR.obj : MTCHSTR.CPP C:\C700\INCLUDE\stdIib.h 

C:\C700\INCLUDE\conio.h\ 

C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 

CAC700\INCLUDE\graph.h C:\C700\INCLUDE\float.H 
C:\C700\INCLUDE c \tim^ C:\C700\INCLUpE\fstream^h\ 

C:\C700\MFC\INCLUDE\afx.h matchng.h PIC_PR0.h MtchTplZh 

shift.h\ 

filemnp.h C:\C700\INCL-UDE\iostream.h 
C-\C700\MFC\INCLUDE\afx.inl\ • m4 . ^ w 

c\ilya\lib\mylib.h C:\C700\INCLUDE\direct.h ..\LIB\p.c_mch7.h\ 
\LIB\projctn7.h ..\LIB\res_mch7.h ..\LIB\lin_tm7.h\ 
C:\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C \C700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 
C:\C700\INCLUDE\vmemory.h C:\C700\INCLUDE\math-h 

!IF $(DEBUG) 

@S(CXX) @«objA$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /F oo bj\MTC H STR. obj MTCHSTR.CPP 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\MTCHSTR.obj MTCHSTR.CPP 
« 

IENDIF 

obj\MTCHSTR.sbr : MTCHSTR.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\conio.h\ 

C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 
C:\C700\INCLUDE\graph.h C:\C700\INCLUDE\float.H 

C\C700\INCLUDE\time.h\ 

C \C700\INCLUDE\ctype.h C:\C700\INCLUDBfstream.h\ 
C:\C700\MFC\INCLUDE\afx.h matchng.h PIC_PR0.h MtchTpl2.h 

shift.h\ 

filemnp.h C:\C700\INCLUDE\iostream.h 
C:\C700\MFC\INCLUDE\afx-inlV 
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c:\ilya\lib\mylib.h CAC700VINCLUDE\d,rect.h \LIB\p.c_mch7.h\ 
\LIB\projctn7.h ..\LlB\res_mch7.h .ALIB\hr ^trn7.h\ 
C \C700\ NCLUDEVios.h C:\C700\1NCLUDE\streamb.h\ 
C : C700\ NCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 

MFS(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^^S^"^t^»^^ MTCHSTR.CPP 
« 

!ELSE @$(CXX) @«obj\$(PROJ).rsp 
SwS2S^^o«^CHSTR.abr MTCHSTR.CPP 

IENDIF 

objWICALLOC.obj : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
J CAC700\INCLUDE\stdio.h C:\C700\INCLUDE\vmemory : h\ 
C:\C700\INCLUDE\malloch 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

Sc^gT^ 

« 

•ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

« 

IENDIF 

obiWICALLOC.sbr : ..\LIBWJCALLOCCPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDEWmemory.h\ 
C:\C700\INCLUDE\maIloch 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 



« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
^CX^^GS^^7RRobj\VICALLOC.sbr .ALIBWICALLOC.CPP 
« 

IENDIF 

obj\PR0JCTN7.obj : .ALlB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
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SBRS = obj\MTCHSTR.sbr objWICALLOC.sbr obj\PROJCTN7.sbr 

° bjAL "™piCJV17.sbr obj\RES_MCH7.sbr objXFILEMNP.sbr 
obj\MTCHTPL2.sbr\ £• 
obj\COR_FNC2.sbr 

all: obj\$(PROJ).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .obj .sbr .cpp 

objXMTCHSTR. obj : MTCHSTR.CPP C:\C700\INCLUDE\stdlib.h 
C:\C700\INCLUDBconio.h\ . 

C\C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 
C;\C700\INCLUDE\graph.hC:\C700\INCLUDBfloat.H 

C:\C700\INCLUDE\time.h\ 

C:\C700\INCLUDE\ctype.h C:\C700\INCLUDE\fstream^\ 
C:\C700\MFC\INCLUDE\afx-h matchng.h PIC_PRO.h MtchTpIZn 

shift.h\ 

filemnp.h C:\C700\INCLUDE\iostream.h 
C:\C700\MFC\INCLUDE\afx.inl\ . u ^ uv 

c-\ilya\lib\mylib.h C:\C700\INCLUDE\direct.h ..\LIB\p.c_mch7.h\ 
\LIBVproictn7.h ..\LIB\res_mch7.h ..\LIB\lin_trn7.h\ 
C-\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C-\C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
C:\C700\INCLUDE\vmemory.h C:\C700\INCLUDEYmath.h 

!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /F oobj\MTC H STR. obj MTCHSTR.CPP 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFI_AGS_G) _ Mn 

$(CXXFLAGS_R) /F oobj\MTC H STR. obj MTCHSTR.CPP 

IENDIF 

objXMTCHSTR. sbr : MTCHSTR.CPP C:\C700\INCLUDE\stdlib.h 
C:\C700\INCLUDE\conio.h\ . 

C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 
C:\C700\INCLUDE\graph.h C:\C700\INCLUDE\float.H 

C:\C700\INCLUDE\time.h\ 

C \C700\INCLUDE\ctype.h C:\C700\INCLUDE\fstream.h\ 
C:\C700\MFC\INCLUDE\afx.h matchng.h PIC_PRO.h MtchTpl2.n 

shift.h\ 

filemnp.h C:\C700\INCLUDE\iostream.h 
C:\C700\MFC\INCLUDE\afx.inl\ 
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c\ilya\lib\myl«b.h C:\C700VINCLUDE\direcLh ..\LIB\p.c_mch7.h\ 
\LIB\projctn7.h ..\LIB\res_mch7.h -\LIB\lirUm7.h\ 
C \C700\ NCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
CAC700 NCLUDBistream.h C:\C700\INCLUDE\ostream.h\ 
CAC7So\INCLUDE\vmemory.hCAC700\INCLUDE\math 

UF S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

f^^fAmcnsiR^ MTCHSTR.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
^^F^G^WFRobjAMTCHSTR-sbr MTCHSTR.CPP 



« 



IENDIF 

obiWICALLOC.obj : ..\LIBWlCALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h CAC700MNCLUDE\vmemory.h\ 
CAC700\INCLUDE\maIloc.h 

!1F$(DEBUG) • 

@$(CXX) @«obj\$(PROJ).rsp 

$(C&^^stD)^Foobj\VICALLOC.obj .ALIBWICALLOC.CPP 
!ELSE 

@$(CXX) @«objA$(PROJ).rsp 
^(C)OCF^G^R) ( /Foobj\VICALLOC.obj .ALIBWICALLOC.CPP 
IENDIF 

obiWICALLOC sbr : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
CAC700MNCLUDE\stdio.h CAC700\INCLUDBvmemory.h\ 
CAC700\INCLUDE\malloc.h 

!IF S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^G^^P Rob J WICALLOC sbr ALIBWICALLOC.CPP 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 

^C^F^G^TFRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

IENDIF 

obj\PROJCTN7.obj : ..\LIB\PROJCTN7.CPP CAC700\INCLUDE\graph.h\ 
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C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 

'•^ ,BXP C°\C700\!NCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 

c!\C700\INCLUDBistream.hC:\C700\INCLUDBostream.h\ 

C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«ob]\$(PROJ)-rsp 

$(C)0^s!.D)ffoob |V ROJCTN7. 0 bi.AL 1B VPROJCTN7CPP 

« 

!ELSE @$(CXX) @«obj\$(PROJ).rsp 
1ENDIF 

obi\PROJCTN7.sbr : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 

.\LIB\proictn7.h\ _ 

C \C7O0\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
C:\C7O0\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^GS^7FRobj\PROJCTN7.sbr ..\LIB\PROJCTN7.CPP 
« 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFI_AGS_G) „„„ 
$(CXXFLAGS_R) /FRobj\PROJCTN7.sbr ..\LIB\PR0JCTN7.CPP 

1ENDIF 

obj\L TRN7.obj : .ALIB\L_TRN7.CPP C:\C700\INCLUDE\stdlib.h\ 
~ C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\conio.h\ 

C \C700\INCLUDE\mal!oc.h .ALIBWicalloc.h ..\LIB\lin_trn7.h\ 

C:\C700\INCLUDE\vmemory.h ..\LIB\projctn7.h ..\LIB\res_mch7.h\ 

..\LIB\pic_mch7.h C:\C700\I NCLUDEXmath.h 
C:\C700\INCLUDE\graph.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\L_TRN7. obj ..\LIB\L_TRN7.CPP 
<< 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
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$(CXXFLAGS_R) /Foobj\L_TRN7.obj ..\LIB\L_TRN7.CPP 



IENDIF 



C:\C700\INCLUDE\graph-h 

np S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

« 

'ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
SS1 G r17fW.TRN7.sU..VL,B^_T R N7.CPP 

« 

!END1F 

obi\PIC MT.obj : .ALIBYPIC_M7.CPP C:\C700\INCLUDFAstdlib.h\ 
J C-\C700\INCLUDE\stdio.h C:\C700\INCLUDE\graph.h 

t^^^BSS^ CAC700UNCLUDEVfcnt..h 

C ^Sn^^LlH CACTOOMNCLUDE^al.oc.h .AL.B*hdr.hX 

.ALlB\projctn7.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

£§^L^D5^oot^lC.M7.o« -AL.BVP1C_M7.CPP 
« 

1ELSE 

@S(CXX) @«obj\$(PROJ).rsp 



'.END IF 



obi\PIC M7.sbr : .ALIB\PIC_M7.CPP CAC70O\INCLUDE\stdlib.h\ 
J CAC700\INCLUDE\stdio.h CAC700\INCLUDE\graph.h 

°^^^LlH CAC700MNCLUDE^Ioc* .AL.BXphdr.hV 
^Snoc h .ALIB\ P ic_mch7.h CAC700\lNCLUDEWmemory.hV 
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..\LlB\projctn7.h 
UF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) ^ 
$(CXXFLAGS_D) /FRobj\PlC_M7.sbr ..\LIB\PIC_M7.CPP 

!ELSE 

@S(CXX) @«obj\S(PROJ).rsp 

« 

JENDIF 

obj\RES MCH7.obj : ..\LIB\RES^MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
C \C700\INCLUDBvmemory.h „\LIB\pic_mch7.h .ALIB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h ..\LIB\projctn7.h C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXF1_AGS_G) 

$(CXXFLAGS_D) /Foobj\RES_MCH7.obj ..\LIB\RES_MCH7.CPP 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\RES_MCH7.obj .AL1B\RES_MCH7.CPP 
iENDIF 

obj\RES_MCH7.sbr : ..\LIB\RES_MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
C \C700\INCLUDE\vmemory.h ..\LIB\pic_mch7.h .ALIB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h ..\LIB\projctn7.h C:\C700\INCLUDBmath.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\RES_MCH7.sbr ..\L!B\RES_MCH7.CPP 
« 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\RES_MCH7.sbr ..\LIB\RES_MCH7.CPP 
« 

IENDIF 

obj\FILEMNP.obj : F1LEMNP.CPP C:\C700\INCLUDE\stdlib.h\ 
C\C700\INCLUDE\string.h C:\C700\INCLUDE\io.h\ . 
C \C7O0\MFC\INCLUDE\afx.h C:\C700\INCLUDE\directh\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\time.h\ 
C:\C7O0\MFC\INCLUDE\afx-inl 

!IF$(DEBUG) 
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@S(CXX) @«obj\$(PROJ).rsp 

« 

•ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

« cr 

!ENDIF 

obftFILEMNP sbr : FILEMNP.CPP C:\C700\INCLUDBstdlib.h\ 

C \C700\MFC\INCLUDE\afx.h C:\C700\INCLUDBdirecth\ 
CAC700\INCLUDE\stdio.h C:\C700\INCLUDBtime.h\ 
C:\C700\MFCMNCLUDE\afxJnI 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^GS^7FRobj\FlLEMNP.sbr FILEMNP.CPP 

« 

'ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\FILEMNP.sbr FILEMNP.CPP 
« 

• ENDIF 

obi\MTCHTPL2. obj : MTCHTPL2.CPP C:\C700\lNCLUDEWmemory.h\ 
C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stdlib.h\ 
C \C700\INCLUDE\conio.h C:\C700\INCLUDE\malloc.h\ 
C:\C700\INCLUDE\float.H C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\string.h matchng.h MtchTpI2.h cor_fnc2.h\ 
c\ilya\lib\mylib.h ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
..\LlB\res_mch7.h PIC_PR0.h ..\LIB\lin_trn7.h 

CAC700\INCLUDE\math.h\ ' 

C \C700\INCLUDE\direct.h C:\C700\MFC\INCLUDBafx.h filemnp.h\ 
C:\C700\INCLUDE\time.h C:\C700\MFC\INCLUDE\afx.inl 

!IF $(DEBUG) 

@${CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\MTCHTPL2.obj MTCHTPL2.CPP 
<< 

1ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\MTCHTPL2.obj MTCHTPL2.CPP 
« 

•1ENDIF 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCTAJS94/01679 



«hi\MTrHTPL2 sbr • MTCHTPL2.CPP C:\C700\INCLUDEWmemory.h\ 

c'\C700\INCLUDE\conio.h C:\C700UNCLUDE\malloc h\ 
CAC700\INCLUDE\floatH C:\C700\lNCLUDBgraph.h\ 
CAC70O\INCLUDBstring.h matchng.h MtchTplZh cor_fnc2.hV 
cAilya\lib\mylib.h .ALIB\projctn7.h .ALIBXpic _mch7.h\ 
\LIBVes_mch7.h PlC_PRO.h ..\LIB\lin_tm7.h 

CAC ^S^ CAC700VMFCUNCLUDBaf.h fi .e m np.hX 

CAC700\INCLUDBtime.h CAC700\MFC\INCLUDBafx..n! 

!!F S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

SroS^Dl^Ro^CHTPli^r MTCHTPL2.CPP 
« 

•ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

^C^F^G^7FRobjAMTCHTPU.sbr MTCHTPL2.CPP 
« 

!ENDIF 

ob.ACOR FNC2.obj : COR_FNC2.CPP CAC700\INCLUDE\stdio.h\ 
CAC700\INCLUDBstdlib.h CAC700\INCLUDE\conio.h\ 
CAC700\INCLUDBfloat.H CAC700\INCLUDE\graph.h cor_fnc2.h\ 
\LIB\pic_mch7.h .ALIB\res mch7.h CAC700\INCLUDE\vmemory.h\ 
..\LIB\projctn7.hCAC700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\COR_FNC2.obj COR_FNC2.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXF1_AGS_G) 

$(CXXFLAGS_R) /Foobj\COR_FNC2.obj COR_FNC2.CPP 
IEND1F 

obi\COR FNC2.sbr : COR_FNC2.CPP CAC700\INCLUDE\stdio.h\ 
CAC700\INCLUDE\stdIib.hCAC700\INCLUDE\conio.h\ 
C : \C700\INCLUDE\float.H CAC700\INCLUDE\graph.h cor_fnc2.n\ 
\LIB\pic_mch7.h .ALIB\res_mch7.h CAC700\INCLUDE\vmemory.h\ 
.ALIB\projctn7.h CAC700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^^F^G^Dl7FRobjACOR_FNC2.sbrCOR_FNC2.CPP 
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•ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) ^ oo 
$(CXXFLAGS_R) /FRobj\COR_FNC2.sbr COR__FNC2.CPP 
« 

1ENDIF 



obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 

objA$(PROJ).exe : $(OBJS) 

-$(NMAKEBSC1 ) MAKEFLAGS= 

-$(NMAKEBSC2) $(NMFU\GS) -f $(PRO JFILE) obj\$(PRO J).bsc 
!1F $(DEBUG) 

$(LRF) @«obj\$(PROJ).lrf 
$(RT_OBJS: = +* 
) $(OBJS: = +* 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: = 
) + 

$(LLIBS_G: = + A 
) + 

$(LLIBS_D: = + A 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_D); 
« 

!ELSE 

$(LRF) @«obj\$(PROJ).lrf 
$(RT_OBJS: = 
) $(OBJS: = + A 
) 

$@ 

$(MAPFILE_R) 
$(LIBS: = + A 
) + 

$(LLIBS G: = + A 
) + 

$(LLIBS_R: = + A 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_R); 
« 

IENDIF 

$(LINKER) @obj\$(PROJ).lrf 
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.cpp.obj : 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
S(CXXFLAGS_D) /Fo$@ $< 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_R) /Fo$@ $< 
« 

IENDIF 

.cpp.sbr : 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
S(CXXFLAGS_D) /FRS@ $< • 
« 

'.ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FR$@ $< 
« 

!ENDIF 



run: obj\$(PROJ).exe 

obj\$(PROJ).exe $(RUNF1_AGS) 

debug: obj\$(PROJ).exe 

CV $(CVFLAGS) obj\$(PROJ).exe $(RUNFLAGS) 
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//return file name without extwntion in "name" and TRUE 1 if file exist; 
int nextpict(char -name.char *mask,char *ext,int num); 
,nxn /rrfnum=-2initalisation; 



// -1 next 
// >0 adding this # to mask 
// and reinialise to this # 
// NULL if notexist file with ".ext" 



short MaskDecoding(char *msk); 

CString MakeName(char *p ); 
CString MakeName(CString N); 
//==================== 
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#ifndefMATCHNG 
#define MATCHNG 
#include "mylib.h" 

#define EXTANTION ".sg2" 

#define MaxProtoNum 40 
#define MaxWinNum 40 
#define PRESENT_HIGHT 32 
#define MaxSignSize 256 

#define CALCULATI0N_HIGHT 16 

#endif 
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#ifndefTEMPLT 
#define MtchTFLT 
#include "projctn7.h" ^ 
#include "pic_mch7.h" 
#include "res_mch7.h" 
#include "pic_pro.h" 
#define NTSC 0 
#define HS1 1 
#define New_plan 2 
#define RGB 3 
#define LUMIN_THR 4 
#define IHS 5 
class RsltNow 
{public: 

short voices; // voiting numbers 

double value; //value 
RsltNow::RsltNow(){voices=0;vaiue=0;} _ 
RsltNow:: RsltNow(short d.double v){voices=d;value-v;} 

}; = 

//====================== = 

class RSLT 

{ public: 
RsltNow R; 

short pos; // position in string 
short ShNumb; 
short ProtoNum; 
short StrNum; 
RSLT::RSLT(){}; 

RSLT::RSLT(short num.short p, double v, 
short shft,short pro.short st) 
{R=RsltNow::RsltNow(num,v); 
pos=p; 

ShNumb=shft; 
ProtoNum=pro; 
StrNum=st; 
} 

}; 
// 



double"calcCorrThresh(short * Hst,short HDim, short NPntAboveThr, 

int PlusThresh, double PrcntLvl=0); 
double CorrelationEstim(double C, double MinVal.double MaxVal, 
void*Addlnf=NULL); 

void MatchForProtoStr(PCT &T.PRT &P,SCR_PNT winsize, short winstep, 
double *CorrThresh, RsltNow "NowRslt, 
short 'StripEnds); 

#endif 
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#'rfndef PIC_PRO 
#define P1C_PR0 
#include <stdlib.h> 
#include <direct.h> 
#include <afx.h> 
#include <pic_mch7.h> 
#include "filemnp.h" 

#define STR_MAX 4 _ __„__ 

//================ ===-==- 

const SCR_PNT z_0(0,0); 
class PRT:public PCT 

{public: 
//information 

CString PathName; 
CString FRAME_Number 
CString STRING_name; 
CString SIGN_name; 

short Pos; // Position in the string 
long NumberOfChk,MaxNum; 
double *Charact; 
//models 

PRT::-PRT() 

{this->free_PCT(); 
Pos=0; . 

if(MaxNum) 

delete Charact; 
Charact=NULL; 
MaxNum=NumberOfChk=0; 

} 

II — 

PRt::PRT() 

{NumberOfChk=MaxNum=s_cols=s_rows-0; 

Charact=NULL;pict=NULL; 
} 



PRT::PRT (short n_cols, short n_rows) 
{*(PCT *)this=PCT::PCT(n_cols,n_rows); 
NumberOfChk=MaxNum=0; 
Charact=NULL; 
} 



int read_proto_SGN(char ext[]=".sgn") 
CString new_name(' ',80); 

PathName=MakeName(PathName); 
new_name=PathName+ext; 
char now[80]; 

ill 
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jf(i(datfp=fopen((const char*)new_name/r'))) return 1; 
if (f scanf(datfp,"%T\n]s "^EORgoto ERR; 
if(fscanf(datfp,"%s ",now)=EOF)goto ERR; 
if(fscanf(datfp,"%s ",now)==EOF)goto ERR; 
if(fscanf(datfp."%s ",now)==EOF)goto 
ERR;FRAME_Number=now, 

if(fscanf(datfp,"%s ",now)=EOF)goto 
E^STRING^nov, .^^^ ERR; S, GN .^ 
FRAME_Number.MakeUpper(); 
STRING_name.MakeUpper(); 
SlGN_name.MakeUpper(); 
fclose(datfp); 
return 0; 
ERR:fc!ose (datfp); return 1; 

} 



'int proto~storage_rgb(char -name, struct _videoconfig vc.char -ext-".sgn") 
{*(PCT*)this=sign_storage_rgb(name,vc); 

if (!s_cols) return 1; 
PathName=MakeName(name); 
if (read_proto_SGN(ext)) 

{free_PCT(); 
return 1; * 
} 

return 0; 
} • 

//__ - — 

int read_proto_DBC(FILE *datfp) 
{ 

char now[80]; 

if(fscanf(datfp,"%s ",now)==EOF)goto 
ERR;PathName=MakeName(now); 

if(fscanf(datfp,"%s ",now)==EOF)goto 
ERR;FRAME_Number=now; 

if(fscanf(datfp,"%s ,, ,now)=EOF)goto 
ERR"STRING name=now; 

if(fscanf(datfp,"%s ",now)==EOF)goto ERR; SIGN_name=now; 

if(fscanf(datfp,"%d ",&(this->s_cols))==EOF)goto ERR; 

FRAME_Number. MakeUpper() ; 

STRING_name.MakeUpper(); 

SIGN_name.MakeUpper{); 

return 1; 
ERR: return 0; 



} 

//==== 



int alloc_Charact_dbl(long Num) 
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if(!(Charact=new double[Num])) return 1; 
MaxNum=Num; NumberOfChk=0; 
return 0; 



} 

// ~ 

void free_Charact() 
{delete Charact; 

Charact=NULL; 

} 

int read_Charact_dbl(FILE *inp,long Num) 

{short i; 

double d; 

jf(MaxNum<(NumberOfChk+Num)) return 1 ; 
for (i=0;i<Num;i++) 

{if(fscanf(inp,"%lf ",&d) ==EOF) return 1; 
if(fabs(d)<1 .Oe-4) d=0; 

Charact[NumberOfChk]=d; 
NumberOfChk++; 
} 

return 0; 

> _____ 

// — " ~ 

double CorrValue(short WNum.short Pnum) 
{return (*(Charact+(long)WNum*s_cols+Pnum)); 

} 

//========================== = 



//======RETURN NUMBER OF STRIPS 

int read_target_SGN(SCR_PNT vrtDHl.char extrj=".sgs") 
{int n=0,j,FLG,s; 
CString new_name(' '.80); 

PathName=MakeName(PathName); 
new_name=PathName+ext; 
char now[80]; 
FILE *datfp; 

if(i(datfp=fopen((const char*)new_name,"r"))) return 1; 
if(fscanf(datfp,"%T\n]s ")==EOF)goto OUT; 
if(fscanf(datfp,"%s ",now)==EOF)goto OUT; 
if(fscanf(datfp,"%s ",now)==EOF)goto OUT; 
if(fscanf(datfp,"%s ",now)==EOF)goto 
OUT;STRING name=now; - 

i7(fscanf(datfp."%s ",now)==EOF)goto OUT; SIGN_name=now; 
"rf((s=PathName.ReverseFindOV))<0) 
s=PathName.ReverseFind(':'); 
FRAME_Number= 

PathName.Right(PathName.GetLength()-s); 

i •<? 
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STRING_name.MakeUpper(); 
SIGN_name.MakeUpper(); 

do{ 

«(FS5tort(cW*.-%d %d «, & (vrt[n]D].c) 1 &(vrttnlD].r)))==EOF) 
goto OUT; 

n++; 

while(n<STR_MAX-1 ); 
OUTrfclose (datfp); return n; 

> . 

//— " " 

y/====~====================== =========SI 



#define UnKnown -1 



typedef struct 

{ short n; // voiting numbers 
short pos; // position in string 
double value; //value 
} RSLT_old; 



void HistCollect(short NOfWin.short Stshort Rn,PRT &Db)j 
RSLT old LineEstimation (short TagSize, PRT &Db, short NOfWin, 

short WSize.double Thr); 
int Linelnf(const PRT &P. PRT T. short rw, short Xpos.struct videoconfig vc); 
double Linlnter( PRT &P. short WNum, short WStze .double Pt), 
void HistThresh(short "H.short -BotThr.short TopThr.short num); 



#endif 
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#include ,, lin_trn7.h" 
double VShiftO[4]= { 

{0.0, 0.0, 0.0, 0.0} 

,{-2,+2,+2,-2} 

,{+2,-2,-2,+2} 

// ,{0.125,0,0,0.125} 

// ,{-0.125,0,0,-0.125} 

// ,{0,0.125,0.125,0} 

// .{0,-0.125,-0.125,0} 

// {0.125,0.125,0.125,0.125} 
// , {-0.125,-0.125,-0.125,-0.125} 

// }; 

//=========== === ,{0.1875,0,0,0.1875} 

//============== ,{-0.1875,0,0,-0.1875} 

//============== {0,0.1 875,0.1 875,0} 

//============== {0,-0. 1 875,-0. 1 875, 0} 

7/ ,{0. 1 875,0. 1 875,0. 1 875,0. 1 875} 

/7 {-0.1875,-0.1875.-0.1875,-0.1875} 
// .{0.35,0.35,0.35,0.35} 

void VrtxCalculation(PRT &T,double sh[4],SCR_PNT NewVffl, 
SCR.PNT OidV[4]) 

{short j,k,MaxV; 

MaxV=T.s_rows; 

match_vertex( OldV); 
SCR_PNT v[4]; 



DIR_LINE top(OldV[3],0ldV[0]),down(OldV[1],OldVl2]); 
DIR_LINE top_new,down_new; 

vert_for_map(*((PCT *)(&T)),top,down,&top_new,&down_new); 
PT st1 =do\wn_new.Start_p(),st2=top_new.Start_p(), 
endl =down_new.End_p(),end2=top_new.End_p(); 



PT_SCR(st2,v[3]); 
PT_SCR(end2,v[0]); 
PT_SCR(st1,v[1]); 
PT_SCR(end1,v[2]); 
match_vertex( v); 



v[0]=OldV[0];v[1]=OldV[1];v[2]=OldV[2];v[3]=OldV{3]; 

//==================================- : 

forG=0;j<4;j++) 
{ 

NewVQ].c=v[j].c; 
k=(G%2)?j-1:j+1); 
if (fabs(sh[j])<1) 
{NewVO].r=(shm?(short)((v[j].r-v[k].rrsh[j])+ 
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vfl].nvO].r); 
} 

else 

NewVD].r=vD].r+shD]; 
NewVQ].r=__max(0, _min(NewVffl.r,MaxV-1 )), 

while((NewVI1].r-NewV[0].r)<8) 
{NewVI1].r=__min(NewV[1].r-M- < MaxV-1 ); 
if((NewVl1 ].r-NewV[0].r)<8) 

NewV[0].r= rnax(0, NewV[0].r-); 

while((NewV[2]. r-NewV[3].r)<8) 
{NewV[2].r=_min(NewV[2].r-M-,MaxV-1); 
if((NewV[2].r-NewVI3].r)<8) 

NewVt3].r=_max(0, NewV[3].r-); 

} 

> = _ = _ ================ ================== 
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#include <stdlib.h> 
#include <string.h> 
#include <io.h> 
#include <afx.h> 
#include <direct.h> 



//return file name without extwntion in "name" and TRUE 1 if file exist; 
int next_pict(char *name,char *mask,char "ext.int num) 

//if num=-2 initalisation; 

// -1 next 

// >0 adding this # to mask 
// and reinialise to this # 
// NULL if notexist file with ".ext" 

{static int now; 
char full_name[80]; 
strcpy(name,mask); 
if (num==-2)now=0; 
else if (num==-1 ) 

now++; 
else if (num<0) return 0; 
else now=num; 

_itoa( now, name+strien(name), 1 0); 

strcat(strcpy(full_name,name),ext); 

//1 if file exist 
retum(!_access( full_name, 0 )); 
} 

//============================================ = 



short MaskDecoding(char *msk) 
{char *p,nm[40]; 
strcpy(nm,msk); 
if(p=strrchr( nm, (int) "W )) 

p+=2; 
else 

if(p=strrchr( nm, (int)':' )) 
p+=2; 
else 

p=nm+1; 
*(p+2)='\0'; 
return ((short)atoi( p )); 
} 

//================================= 

CString MakeName(CString N) 

short k=(N.Spanlncluding(" \t")).GetLength(); 
char *p,fp[80]; 

p=((char*)(const char *)N)+k; 
CString M=p; 12.3 
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if(M.Find(': , )<0) 
{if(M.GetAt(0)== , \Y) 
{M=':'+M; 

M= (char)(_getdrive( )-1 + A)+M; 

} 

M=_fullpath(fp, (const char -)M,80); 

M.MakeLower(); 
return M; 

CString MakeName(char *p ) 

{CString M(p); 

return (MakeName(M)); 

}/ —=-======================= 
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#include <vmemory.h> 
#include <stdio.h> 
#include <stdlib.h> 
#include <conio.h> 
#include <malloc.h> 
#include <float.h> 
#include <graph.h> 
#include <string.h> 

#include "matchng.h" 
#include "mtchtpl2.h" 
#include "cor_fnc2.h" 

#define MAX_LINE 1024 

//extern short NumberOfWin; 
extern double GAMMA,Thresh_mdl; 
extern short MAP; 
extern short VOITING; 
extern struct _videoconfig vc; 

#define ProbValue(S,x) (2*(double)(x)/((S)-1.0)-1.0) 
void draw_color_corr_1 (COLOR_VEC corr, short F.double THRESH, 
short posjiow); 

//==================================================== : 

double CalcCorrThresh(short * Hst.short HDim, short NPntAboveThr, 
int PlusThresh, double PrcntLvl) 

{double out; 

short sum=0,N=0,ist,incr; 
if (PrcntLvl) 

{for(ist=0;ist<HDim;N+=Hst[ist++]); 
NPntAboveThr=short (N*PrcntLvl+0.5); 

} 

// — 

if (PlusThresh) 

{ist=HDim;incr=-1;} 
else 

{ist=-1;incr=1;} 
// POINT PARAMETER; 
do{ 
ist+=incr; 
sum+='(Hst+ist); 

while((sum<NPntAboveThr) && (ist>=0) && (ist<HDim)); 

out=ProbValue(HDim,ist); 

return out; 

} 

l&S 
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//============== = 

^uble^elationEstimldouble C, double MinVal.double MaxVal, 
void*Addlnf) 

* if (C<MinVal) return MinVal; 
if (C>MaxVal) return MaxVal; 
return C; 

COLOR^^ p1 Rouble Threshmdl) 

{ switch ( MAP) Kn-cnv 
{case NTSC:return(color_space_NTbu;, 
case New_pian:return(coior_space_NEW); 
case HSI:return(color_space_RGB); 
case RGB:retum(color_space_RGB_s.mple ; 
case LUMIN_THR:return(color_space_LUMIN_THR), 
case lHS:retum(color_space_IHS); 

}; 

return NULL; 



cons"t short CH_HIGHT=80, c ^^^ ssss3SSS=sssssssssssss 
voT^^ 

double -CorrThresh.RsltNow *NowRslt, 
short *StripEnds) 

{ 

vc.numxpixels ,CH_BASE ), 

double crmdl; 
short i; 

char mess[40]; 

COLOfTvEC Cp_funct)(COLOR_RGB P 1 .double Thresh.mdl); 

p_funct=PointColFunct(); 
// PCT win(winsize.c.winsize.r); 
// PCT tag(winsize.c.winsize.r); 

SCR_PNT st t,st_win; 

AVERAGE VEC middle_win,middle_tag; 

const AVERAGE_VEC z={{0,0,0},{0,0,0}}; 

COLOR_VEC cr; 
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const COLOR_VEC z_col={0.0,0.0,0.0}; 

st_t.r=0; 
st win.r=0; 
short k,StripStart, StripStop; 
double ValueNow[1 024]; 

// double *ValueNow=new double[P.s_cols+T.s_cols], 

short PartNum; 

k=PartNum=0; 

while(StripEnds[PartNum]>=0) 
{StripStart=StripEnds[PartNum++]; 

StripStop=StripEnds[PartNum++]; 

for (st win.c=StripStart; . 
st win.c + winsize.c<=StripStop;st_win.c + =w.nstep,k++) 

{ 

midd : |e_win=average2(PThresh_ m dl,winsize,st_win,p_funct); 

const COLOR_VECz_UNIT={1-0,1.0,1.0}; 

for(i=0;i<P.s_cols+T.s_cols;ValueNow[i++]=0.0); 

for(st_t.c=0;st_tc<=T.s_cols-winsize.c;st_t.c++) 
short EndPointOfProNow= p ^-^^-}^^--L 

//== ^dlTta^^ 
// DIFF ABS VALUES 

#ifd6f crSmXte.oonv.ZC T.P.Thresh_mdl,z_UNIT,win S ize,st_t,st_win, 

// s^pyTmess," VECTOR Approach to CORRELATION "); 

cr= Correlation_single_1 (cr,middle_tag,m.ddle_ W in.z_UNIT), 
crmdl=cr.c[0]; 

#else 

#ifdef ABS_VALUE ss ^ ^ ^ values „ ); 

CP= template_abs_diff_1 (tag,win,Thresh_mdl,z_UNIT.p_funct, 
middle_tag,middie_win); 

#elSS cr=template_conv_1( tag,win,Thresh_mdl,z_UNIT lP _funct); 

strcpy(mess." PEARSON CORR. "); 
cr=Correlation(cr,middle_tag,midd!e_win,z_UNIT); 

crmdl=0.333333"(cr.c[0]+cr.c[1]+cr.c[2]); 

#endif 
#endif 

if (crmdl> CorrThresh[kl) 
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ValijeNow{Ep.dPointOfProNow3=crmdl; 

draw_co1or_corr_1( cr, F.0.3,EndPointOfProNow); 
F=0; 
} 

double old=0,next,Val,now, 
next=ValueNow[0]; 
for(i=0;i<P.s_cols+T.s_cols;i++) 

{ 

now=next; 

n ^ c t ss (i«P.s_cols+T.s_cols-1 )?0:ValueNow[i+1 ]; 

Val= max( max(now,next),old); 

if(Val) 

{NowRslt[i].value+= Val; 

NowRslt[i].voices++; 

} 

old=now; 

} 
} 

//2================== delete (ValueNow); 

return ; 

} = __ ============= ================== 



void draw_color_corr_1 (COLORVEC corr.short F. 
double THRESH, 
short pos_now) 
{ 

short j,k,l,i,st; 
static short pos_old; 
short POS; 

static COLOR_RGB corr_old; 
POS=1 0+pos_now; 
_setcolor( color_num(240,240,240)); 
if(F) 
{ 

corr_old.r=k=CH_BASE-2*CH_HIGHT-40; 

st=CH_HIGHT/10; 

for(i=0;i<3;i++) 

^ moveto( 10,k-CH_HIGHT); 
Jineto(10,k); 

lineto(1 0+vc.numxpixels,k); 
"moveto(1 0,k-CH_HIGHT*THRESH); 
Jineto(10+vc.numxpixels,k-CH_HIGHTTHRESH); 

for(l=0,j=1;j<11;j++) 
{l+=st; 
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_moveto( 

(j==5)?5:(G==10)?0:7) 

.k-l); 
_lineto(10,k-l); 

} 

k+=(CH_HIGHT+20); 

corr_old.g=corr_oid.r+C H_H IGHT+20; 
corr_old.b=corr_old.g+CH_HlGHT+20; 
pos_old=10; 

isetcolor( color_num(240,240,240)); 
k=CH_BASE; 

_moveto( pos_old,corr_old.b); 
j=k-(short)(corr.c[2]*CH_HIGHT); 
_lineto((short)(POS) j); 
corr_old.b=j; 

k-=(CH_HIGHT+20); 
_moveto( pos_oid,corr_old.g); 
j=k-(short)(corr.c[1 ]*CH_H!GHT); 
_lineto((short)(POS),j); 
corr_old.g=j; 

k-=(CH_HIGHT+20); 
_moveto( pos_old,corr_dld.r); 
j=Mshort)(corr.c[0]*CH_HIGHT); 
Jineto((short)(POS) j); 
corr_old.r=j; 

pos_old=POS; 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



#include <stdlib.h> 
#include <conio.h> 
#include <stdio.h> 
#include <string.h> 
#include <graph.h> 
#include <floatH> 
#include <time.h> 
#include <ctype.h> 
#include <fstream.h> 
#include <afx.h> 

#include "matchng.h" 
#include "PIC_PRO.h" 
#inciude "MtchTpi2.h" 
#include "shift.h" 
#include "filemnp.h" 

#ifdef .DEBUG 

#defme new DEBUG_NEW 

#endif 

//input Par 

//Files <frame>.RGB; <frame>.sgs; <proto's>.RGB; <proto's>.hs2 

short PlusThresnPnt; //Threshold for histogramme Number Of Points 

double MinimalVal; // for CorrThresh 

double MaximalVal; 

short HighVoiceThreshold=6; 

short median=0; 

short MAP=1; // Color Space 

short WinNum; 

double CorrThresh[MaxWinNum]; 
int lntroduction(int arg.char *a); 
short NumberOfWin.HistDim; 

CString BestName[2]={CString::CString(30),CString::CString(30)}; 

#define MaxNumberOfPoints 1024 
RsltNow NowRslt[MaxNumberOfPoints]; 

short ReadHist(const char *PName,short ***H); 

const short NumberOfShifts=sizeof(VShift)/(4*sizeof(double)); 

void FreeHist( short. NOfWin.short —H); 

void draw_DMF(RsltNow Now .short F.short CH_HlGHT, short CH_BASE, 
short pos_now,double scale); 

double GAMMA=1 .0,CORR_THRESH=0.0,Thresh_mdl=0.0; 
short VOITING=3,TAG_hight; 
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struct _videoconfig vc; 
ofstream LineC; 
const char cieanQ-' 
//================= 



int ReadStrlnf(char *name,short *StD) 
{ifstream InpF; 
char a[80]; 

strcat(strcpy(a,name),".str"); 
short i; 

lnpF.open(a,ios::in|ios::nocreate); 
if(lnpF.fail()) 
{InpF.clear(O); 
return 1; 
} 

InpF.getlineCa.SO.'Vn'); 
lnpF.getli^e(a,80 I , \n , ); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,8u,'\n'); 
i=0; 
do 
{ 

lnpF»StD[i++]; 
if (lnpF.eof()|| i>17) 

{StD[-i]=-1; 

break; 

} 

lnpF»StD[i++]; 
} 

while(1); 
lnpF.close(); 
return 0; 

} 

//==================================--= 

void PUT_NO_MATCH(void) 
{ _settextposition( vc.numtextrows-2,0); 
_outtext( clean ); 

_settextposition( vc.numtextrows-2,0); 

_outtext( "NO MATCH" ); 

} ___ 

//================================ ===-= = 

void FillProtocol(char "m.short StrN.const char *name, RSLT now, int 

AskMess) 

{char mess[40], w p; 

LineC« StrN«" \f«name«" \t"«now.ShNumb«"\t"«now.pos« \t < 
now.R.voices«"\t"«now.R.value«"\t"; . 
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if (AskMess) 

{rf (now. R. value) 

_settextposition( vc. numtextrows-2,0); 

outtext( clean ); 
_ settextposition(vc.numtextrows-2,0); 

~sprintf(mess," %s V=%6g N=%2d",m,now.R.value 1 now.R. voices); 
_outtext(mess ); 
p=mess; 

- while(!isspace( (int)(*p++=(char)getche()) )); 
-(-p)='\0'; 

LineC«" \t"«mess; 

} 

else 

LineC«" \t NO MATCH"; 

} 

LineC«"\n"; 

} ====== === 

//====================== = 



void Pre~sentRslt(char *m,PRT &T.RSLT &R,SCR_PNT *V, short hight,short 
row_n, 

char *p_msk, short CL) 

{ 

SCR_PNT p_p(10,row_n); 

if(R.R. value) 

{ 

if(CL) 

_setcolor( color_num(0,0,0)); 
_rectangle(_GFILLINTERIOR,0,p_p.r, 
680,p__p.r+36); 

_setcolor( color_num(240.240 f 240)); 
PCT t_map=linear_transform(T I V,hight); 
//PCT t_map=linear_transform_cont(T,V,hight); 
sign_present_RGB( t_map,p_p); 

t_map.free_PCT; 

p_p.r+=20; 
char p_name[40]; 
PRT P; 

next^ict(p_narne,p_rnsk 1 ,, .rgb" l R.ProtoNum); 
iffP Droto storage rgb(p name,vc,".str")) 
( P {printffRGB PROTO not exist"); GRAPH_OUT(-1); 

}; 

p_p.c=1 0+R.pos-P.s_cols; 
sign_present_RGB( P,p_p); 

FillProtocol(m,R.StrNum,(const char*) P.SIGN_name, 
R.TRUE); 
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P.free_PCT; 
} 

else 

PUT_NO_MATCH(); 
} 

} ======================== 

//=============== 

CString P ROTO C O L_N AM E; 

//============ OpenLineCollection 

void OpenLineCol(const char*name) 
{LineC.open(name,ios::out|ios::app|ios::nocreate), 

if(LineC.fail()) 

{LineC.clear(O); 

LineC.open(name,ios::out|ios::app|!Os::noreplace), 

if(LineC.fail()) 
{LineC.clear(O); 

cout « "CAN NOT OPEN FILE "«name; 
GRAPH_OUT(-1); 
} 

} 

} ================== 

//==================-== 

int main(int argc.char* argv^) 
{ 

short **Hist; 

const int PlusDir= TRUE; 

short StrDescr[17]; // ONLY 6 partition for string 

if(lntroduction(argc,argv[argc-1 ])) retum-1 ; 

short CalcHight=MaskDecoding(argv[21); // PROTOTYPE HIGHT 

" SSS ^RN^^^f^^^^^^^ GRAPH_OUT(-1); 
PROTOCOL_NAME=argv[1]; 
PROTOCOL NAME+= ,, .mch" ; 
OpenLineCoi((constchar-)PROTOCOL_NAME); 

//================= TARGET LOADING & MEMORY PARAMETERS 

DEFINITION 
PRT TARGET; 
PRTPROTO; 
PCT target_map; 
. const SCR_PNT proto_pos(10,30),target_pos(10,10), 
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T^GCTlvrt[STR_MAX][4].NewVrt[STR.MAX][NumberOfShifts][4]; 
•rf(TARGET.proto_storage^rgb(argvri],vc)) OUTM) - 
{printf("RGB TARGET not exist"); GRAPH_OUT( U 
return -1 ; 

LineC«MAP«" \t"«PlusThresnPnt«" \t"«M.n.malVal 
«" \t"«MaximalVal«" \t"«median«^n , ; 
LineC« "F He \r« argv[1 ]<<" \t ■•«TARGET.SIGN name«^ ; 
LineC<< "S# \t PROTO \t Sh \t Pos \t V \t Value \t Res\n' ; 

if(!NumberOf Strips) 

{LineC«"Did NOT find stnpsXn ; 

printfrSfd noifind lines"); GRAPHOUT(-1); 

return -1 ; 
} 

char proto_name[40]; . 
short ProtoNumber=0; 

RSLT BestRslts[2]; 

BestRslts[0]=RSLT::RSLT(0,0,0,-1 ,0,0); 

BestRslts[1]=RSLT::RSLT(0,0.0,-1,0,0); 
RSLT BestNowRslts[2]; 

// New Vertexes Calculation 

short StripNumber, 
short ShiftNumber; 

forrStripNumber=0;StripNumber<NumberOfStrips;StripNumber^ 

Sr(ShSNu m ber=0;ShiftNumber<NumberOfShifts;Sh.ftNumb // 

return NewVrt after reordering k -i 

VrtxCalculation( TARGET.VShift[Sh.ftNumber], 

NewVrt[StripNumber][ShiftNumber], 
TARGET_vrt[StripNumber]); 

// LOOP OVER STRIPS 

for(StripNumber=0;StripNumber<NumberOfStrips;StnpNumber-K + ) 

// { LOOP OVER PROTOTYPE 

^ ^ N ( rx«:P^(p ro ,o_na m e. a r g vt2,,-.r g b».Prc t oNu mber ,) « RGB 
proto EXIST 

" ^esTw^ 

BestNowRslts[1]=RSLT::RSLT(0.0,0,-1,0,0); 
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/;========" Proto Loading „ .... 

iffPROTO.proto storage_rgb(proto_name.vc str )) 
( {print^RGB PROTO not exist"); GRAPH_OUT(-1);retum -1, 

_|clearscreen( _GCLEARSCREEN ); 
sign_present RGB( PROTO,proto_pos); 
jf(ReadStrln7(proto name.StrDescr)) 

{printfC'SGN PROTO not exist"); GRAPHOUT(-1);retum -1; 

}; 

t 

//======= HIST reading 

CString HNameC-'.eO); 

HName=proto_name; 

HName+=".hs2": 
// here read size of windows from Hist and so on 
SCR_PNT WinSize; 
short winstep.NoHist; 

WinSize.r=CaicHight; 

jf(i(WinSize.c=ReadHist((const char -)HName,&Hist))) 
{printf("Did not find Hist %s",proto_name); 
NoHist=1; 
WinSize.c=8; 

NumberOfWin=MaxWinNum;} 
winstep=WinSize.c; 

/; MEMORY ALLOCATION & inicialisation FOR Decision Making 

short i, for ^_ 0 . j<M ^ W j nNum;CorrTnres hr-,+ + ]=-i.O); 
for (i=0;i<NumberOfWin;i++) 
{if(NoHist) 

Con*Thresh[i]=0.3; 
else 

{ CorrThresh[i]=CalcCorrThresh(*(Hist+i), HistDim. 

PlusThresnPnt,PlusDir,0); 
CorrThresh[i]=CorrelationEstim(CorrThresh[i], 

MaximalVal.NULL); 
} 

} 

if(!NoHist) 
FreeHist( NumberOfWin, Hist); 
II j Mi;!! CorrelationThreshold for all windows 

short NumberOfPoints: 
//============= LOOP OVER SHIFTS 

for(ShiftNumber=0;ShiftNumber<NumberOfShifts; 

ShiftNumber-M-) 
{if(NewVrt[StripNumber][ShittNumber][0].r<0) continue; 
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target_tnap=linear_transfbrm(TARGET^ 
,/ target map=linear_transform_cont(T ARGc , ...... 

" 9 " NewVrt[StripNumber][ShiftNumber].CalcHight), 

NumberOfPoints=PROTO.s_cols+target_map.s_cols; 

setcolor( color_num(0,0,0)); 
~rectang!e( GFILLINTERIOR.0,0, 
vcnumxpixels ,proto_pos.r-1); 

sign_present_RGB(target_map.target_pos); 

//_ Result Initialisation For Every SHIFT 

for(i=0i<MaxNumberOfPomts;i++) 
NowRslt[i]=RsltNow.:RsltNow(); 
„ = Pro to Calculation 

" MatchFcrProtoStraarget.map PROTO *flnS«. instep. 

CorrThresh,NowRslt,StrDescr), 

target_map.free_P CT(); 

//correct filling The BEST For Shift.Proto, Strip 
#ifdef MYDEBUG 
double scale=-1 ; 
for(i=0;i<NumberOfPoints;i++) 

scale=_max(scale, NowRs!t[i].value), 

#endif . . 

for(i=0;i<NumberOfPomts;i++) 

{ if( NowRslt[i].value>BestNowRslts[0].R- value) 

„ = _ = - === ==L======= Not repeat small shifts 

if(abs(i-BestNowRslts[0].pos)>=4) 

BestNowRslts[1]=BestNowRslts[0]; 

BestNowRslts[0].pos=i; 
BestNowRslts[0].R=NowRsltp]; 
BestNowRslts[0].ShNumb=ShiftNumber, 
BestNowRslts[0].ProtoNum=ProtoNumber, 
BestNowRslts[0].StrNum=StripNumber, 
if(BestNowRslts[0].R.voices>=HighVo.ceThreshold) 
{BestRslts[0]=BestNowRslts[0]; 

BestRslts[1]=RSLT::RSLT(0,0.0,-1,0,0); 

PROTO. free_PCT(); 
BestName[0]=PROTO.SlGN_name; 

goto DIRECT_DECISION; 

} 

} 

elS if( (NcwRslt[i].vaiue>BestNowRslts[1].R. value) && 
(abs(i-BestNowRslts[0].pos)>=4)) 

*BestNowRslts[1 ].pos=i; 
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BestNowRslts[1 ].R=NowRslt[i]; 
BestNowRslts[1].ShNumb=ShiftNumber; 
BestNowRslts[1 ].ProtoNum=ProtoNumben 
BestNowRslts[1].StrNum=StripNumben 

} 

u _ May be presentation for analyses 

#ifdef MYDEBUG 

sSch;HIGHT=100, CH_BASE=190; 

setcolor( color_num(0,0,0)); uir;HT 
-rectangle(_GFILLINTERlOR,0 CH BASE-CH HIGHT, 

~ vcnumxpixels ,CH_BAbt 

if(scale) 

for(i=0;i<NumberOfPoints;M 
{draw DMF(NowRslt[i] ,F, CH_HIGHT, CH_BASe, 
" j-PR0TO.s_cols, scale); 

F=0; 

} 

#ifndef RUN 

getchQ; 



#endif 



#endif 



} 

else 

PUT_NO_MATCH(); 



} // Shift closed 
PROTO.free_PCT(); 
ProtoNumber++; 
//==========PROTOCOL PROTO ^ _ ====== 

#ifdef MYDEBUG 
short pp2=10,CL2=TRUE; 
for (i=0;i<2;i++) 

i (D ei«»oRnTn SHIFT RSLT 7 ",TARGET,BestNowRslts[i], 
CalcHight,pp2,argv[2],CL2); 

CL2=FALSE; 
pp2=50; 
} 

#6lSe FillProtocolC'PROTO SHIFT RSLT^StripNumber, (const char*) 

PROTO.SlGN.name. BestNowRs1ls[0]iFALSE); 

#endif 
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GLOBAL MAX 

%?BesrNowRslts[i].R.value>BestRslts[0].R. value) 
{BestRslts[1]=BestRslts[0]; 
BestRslts[0]=BestNowRslts[i]; 
BestName[1 ]=BestName[0]; 
BestName[0]=PROTO.SIGN_name; 

} 

<■ SS jf( BestNowRslts[i].R.value>BestRslts[1].R. value) 
{BestRslts[1 ]=BestNowRslts[i]; 
BestName[1]=PROTO.SIGN_name; 

} 



} //Proto dosed 
} //Strips Closed 
// GLOBAL PROTOCOL OUTPUT 
D!RECT_DECISION: 
#ifdef MYDEBUG 
short i; 

short Rows_n=10,Blan c=TRUE : 

LineC«" Result ™ ■ 

_clearscreen( _GCLEARSCREEN ); 
for (i=0;i<2;i++) 

9»TARGET%Ts\r^^^ 

CalcHighLRows_n,argv[2],Blanc); 

Blanc=FALSE; 
Rows_n+=50; 
} 

#€lSe FillProtocol("GLOBAL RSLT ?",.(const char «)BestRslts[0].StrNum, 
(const char") BestName[0]; 
BestRslts[0],FALSE); 

#endif 
// 

LineC.close{); 
TARGET.free_PCT(); 
GRAPH_OUT(0); 
return 0; 

} =================== 

//================== = 

short ReadHist(const char -PName.short ~H) 
{char p[80]; 
ifstream HFile; 

HFile.open(PName,ios::in|ios::nocreate); 



r&8 

SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



if(HFile.fail()) 

{HFiie.clear(O); 

cout « "CAN NOT OPEN FILE "«PName«"\n ; 
return 0; 

} 

HFile getline(p.80); // LineC«"Histogrammes\n"; 

HFiie getline(p,80); //«argv[1]«"\t"«prototype.S!GN_name« , Vi ; 

HFile»p»NumberOfWin; // «NumberOfWm« , \n'; 

HFile»p»HistDim; /rNumberOrains-IVt'^HistDim^'VV; 
HFile.getline(p,80); //"Win_pos\n"; 
HFile. getline(p,80); //"Win_pos\n"; 

(*H)= new (shortHNumberOfWin])); 
short n.j.i.WindowSize; 

for (i=0;i<NumberOfWin;i++) 
(*H)[i]=new short[HistDim]; 
forG=0;j<NumberOfWin;j++) 

{ifG==1) 

HFile»WindowSize; 

else 

HFile»n; 
for(i=0;i<HistDim;i++) 
HFile»(*H)D]n]; 

} 

HFile. close(); 
return(WindowSize); 

} === - = 

//============================ 



void FreeHist( short NOfWin, short **H) 
{short i; 
for (i=0;i<NOfWin;i++) 
delete H[i]; 
delete H; 

} 



Tnt "geCnumber.matchO // INITIALISATION GRAPHICMODE, GET SCALE 
{ 

GRAPH_OUT(); 

cout « " MAP PlusThresnPnt MinimalVal MaximalVal 
HighVoiceThreshold median \n"; 
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>>MAp C >>PlusThresnPnt>>MinimaiVal>>MaximalVal>>HighVoiceThreshold 
»median; 

_ ======= ======== GRAPHICS START 

jf(GRAPHICS_START(&vc,GRAPHMODE)) GRAPH_OUT(-1 ); 

return 1 ; 

} 

int get_number_rnatchJ(FILE t) // INITIALISATION GRAPHICMODE, GET 
SCALE 

{ fscanf(f," %T\n]s "); 

fscanf(f," %d %d %lf %If %d 
%d" &MAP,&PlusThresnPnt,&MinimalVal,&MaximalVal, 

&HighVoiceThreshold,&median); 
// Threshold for histogramme Number Of Points 
// for CorrThresh 
return 1 ; 

} /=========== ========INTRODUCTlON 

int lntroduction(int arg, char *a) 
{ 

int FLG_F=0; 
FILE "datainf, 
short n=0; 
if((arg != 3) && (arg !=4)) 

printf(" target-file proto_file_mask \n"); 
FLG_F=0; 
retum(1); 

} 

else 
if(arg ==4) 
{FLG__F=1 ; 

jf(!(datainf=fopen(a,"r"))) return 0; 
} 

lf(, igS:number_matchJ(datainf); // GET SCALE AND PARAMETERS 
fclose (datainf); 
} 

else 

get_number_match(); 
return 0; 

} f = _ ====== - ==== ==================================== 



// ^_ Graphic Output 

I HO 
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void draw_DMF(RsltNow Now .short Rshort CH_HIGHT, 

short CH_BASE, 
short pos_now, double scale) 
{ 

short j,k,l,st; 

static short real_srze,pos_old; 
short POS; 
static double old_Y; 
POS=1 0+pos_now; 
_setcolor( color_num(240,240,240)); 
if(F) 

old_Y=k=CH_BASE; 
st=CH_HIGHT/10; 
_moveto( 10,k-CH_HIGHT); 
_lineto(10,k); 
_lineto(680,k); 
_moveto(1 0,k-CH_HIGHT); 
_lineto(680,k-CH_H!GHT); 
for(l=0,j=1;j<11;j++) 
{l+=st; 
_moveto( 

G==5)?5:(G==10)?0:7) 

,k-l); 
Jineto(10,k-I); 
} 

pos_old=1 0; 

_moveto( pos_old,old_Y); 

j=CH_BASE-(short)(Now.value*CH_HIGHT/scale); 

_lineto((short)(POS),j); 

old_Y=j; 

pos_old=POS; 

} _ = 

//========================== 
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ORIGIN = PWB 
ORIGIN_VER = 2.0 
PROJ = STRNEW 
PR0JF1LE = STRNEW. MAK 
BUILDDIR = obj 
DEBUG = 1 

BRFLAGS = /o obj\$(PROJ).bsc 
BSCMAKE =bscmake 
SBRPACK = sbrpack 
NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
BROWSE = 1 
CC =cl 

CFLAGS_G = AA/2 /BATCH /FR$*.sbr/Zn 
CFLAGS_D =/f/Zi/Od 
CFLAGS_R = /f- /Ot /0i /Ol /Oe /Og /Gs 
CXX = cl 

CXXFLAGS G = /AL /W4 /G2 /D_D0S /BATCH /FR$*.sbr /Zn 
CXXFLAGS~D = /f- /0b1 /Od /FPi87 /Z /DMYDEBUG /DRUN /D.DEBUG 
CXXFLAGSlR = /f- /Os /Ol /Og /Oe /Oi /FPI87 /Gs /DMYDEBUG /DRUN 
MAPFILE_D = NUL 

LFuS£g 1 = /NOI /STACK;32000 /BATCH /ONERROR:NOEXE 

LFLAGS.D =/CO/FAR/PACKC 

LFLAGS_R = /EXE /FAR /PACKC 

LINKER" =l"mk 

ILINK = ilink 

LRF = echo > NUL 

ILFLAGS =/a/e 

LLIBS_R = LAFXCR 

LLIBS_D = LAFXCRD 

LLIBS^G = graphics 

CVFLAGS =/25/S 

RUNFLAGS = TST\t10284o plnew.ini 

FILES = COR_FNC8.CPP PIC_M8.CPP VICAL8.CPP RES_MCH8.CPP 
PR0JCTN8.CPP\ 

COMP_FNC.CPP STRNEW.CPP 
OBJS = obj\COR_FNC8.obj obj\PIC_M8.obj obj\VICAL8.obj 
obi\RES MCH8.obj\ 

obj\PROJCTN8.obj obj\COMP_FNC.obj obj\STRNEW.obj 
SBRS = obj\COR_FNC8.sbr obj\PIC_M8.sbr obj\VICAL8.sbr 
obi\RES MCH8.sbr\ .™.,^ A , 

obj\PROJCTN8.sbr obj\COMP_FNC.sbr obj\STRNEW,sbr 

all: obj\$(PROJ).exe 
.SUFFIXES: 
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.SUFFIXES. 

.SUFFIXES: .obj .sbr .cpp 

obj\C0R_FNC8.obj : C0R_FNC8.CPP C:\C700\INCLUDE\stdio.h\ 
C:\C700\INCLUDBstdlib.h C:\C700\INCLUDBconio.h\ 
C:\C700\INCLUDBfloat.h C:\C700\INCLUDE\graph.h cor_fnc8.h 

projctn8.h\ 

pic_mch8.h res_mch8.h C:\C700\INCLUDE\math.h 
C:\C700\INCLUDEWmemory.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\COR_FNC8.obj COR_FNC8.CPP 
« 

IELSE 

@$(CXX) @«obA$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\COR_FNC8.obj COR_FNC8.CPP 
« 

•ENDIF 

objACOR_FNC8.sbr : C0R_FNC8.CPP C:\C700\INCLUDBstdio.h\ 
C:\C700\INCLUDBstdlib.h C:\C700\INCLUDBconio.h\ 
C:\C700\INCLUDE\float.h C:\C700\INCLUDE\graph.h cor_fhc8.h 

projctn8.h\ 

pic_mch8.h res mch8.h C:\C700\INCLUDE\math.h 
C:\C700\INCLUDE\vmemory.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\COR_FNC8.sbr COR_FNC8.CPP 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\COR_FNC8.sbr COR_FNC8.CPP 
« 

IENDIF 

obj\PIC_M8.obj : PIC_M8.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\stdio.h\ 

C:\C700\INCLUDE\graph.h C:\C700\INCLUDE\math.h 

C:\C700\INCLUDE\io.h\ 

C:\C700\INCLUDE\fcntl.h C:\C700\INCLUDE\string.h\ 
C:\C700\INCLUDE\float.h C:\C700\INCLUDE\malloc.h phdr.h vical8.h\ 
pic_mch8.h C:\C700\INCLUDE\vmemory.h projctn8.h 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 
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$(CXXFLAGS_D) /Foobj\PIC_M8.obj PIC_M8.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

${CXXFLAGS_R) /Foobj\PIC_M8.obj PIC_M8.CPP 
<< 

IENDIF 

obj\PIC_M8.sbr : PIC_M8.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\stdio.h\ 

C:\C700\INCLUDE\graph.h C:\C700\INCLUDE\math.h 

C:\C700\INCLUDE\io.h\ 

C:\C700\INCLUDE\fcntl.h C:\C700\INCLUDBstring.h\ 
C:\C700\INCLUDE\float.h C:\C700\INCLUDE\malloc.h phdr.h vica!8.h\ 
pic_mch8.h C:\C700\INCLUDE\vmemory.h projctn8.h 

!1F $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

fZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PIC_M8.sbr PIC_M8.CPP 
« 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\PIC_M8.sbr PIC_M8.CPP 
IENDIF 

obj\VICAL8.obj : VICAL8.CPP C:\C700\INCLUDE\stdlib.h 
C:\C700\INCLUDE\stdio.h\ 

C:\C700\INCLUDE\vmemory.h C:\C700\INCLUDE\malloc.h 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\VICAL8.obj VICAL8.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\VICAL8.obj VICAL8.CPP 
« 

IENDIF 

obj\VICAL8.sbr : VICAL8.CPP C:\C700\lNCLUDE\stdlib.h 
C:\C700\INCLUDE\stdio.h\ 

C:\C700\INCLUDE\vmemory.h C:\C700\INCLUDE\mallpc.h 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
rZs $(CXXFLAGS_G) 
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$(CXXFLAGS_D) /FRobj\VICAL8.sbr VICAL8.CPP 
« 

!ELSE 

@$(CXX) @«cbj\S(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRcbj\VICAL8.sbr V1CAL8.CPP 
« 

IENDIF 

obj\RES_MCH8.obj : RES_MCH8.CPP C:\C700\INCLUDE\stdlib.h\ 

C:\C700\INCLUDE\vmemory.h res_mch8.h 
C:\C700\INCLUDE\grsph.h\ 

projctn8.h pic_mch8.h C:\C700\INCLUDE\math.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\RES_MCH8.obj RES_MCH8.CPP 
!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXF1_AGS_R) /Foobj\RES_MCH8.obj RES_MCH8.CPP 
« 

IENDIF 

obj\RES_MCH8.sbr : RES_MCH8.CPP C:\C700\INCLUDE^tdlib.hV 

C:\C700\INCLUDEWmemory.h res_mch8.h 
C:\C700\INCLUDE\graph.h\ 

projctn8.h pic_mch8.h C:\C700\INCLUDE\math.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRcbj\RES_MCH8.sbr RES_MCH8.CPP 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\RES_MCH8.sbr RES_MCH8.CPP 
<< 

IENDIF 

obj\PR0JCTN8.obj : PR0JCTN8.CPP C:\C700\INCLUDBgraph.h\ 

C:\C700\INCLUDE\stdIib.h C:\C700\INCLUDE\iostream.h projctn8.h\ 
C:\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
C:\C700\INCLUDE\math.h 

!IF S(DEBUG) 

@S(CXX) @«cbj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

IHS 
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$(CXXFLAGS_D) /Foobj\PROJCTN8.obj PROJCTN8.CPP 
!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PROJCTN8.obj PROJCTN8.CPP 
« 

IENDIF 

obj\PROJCTN8.sbr : PR0JCTN8.CPP C:\C700\INCLUDBgraph.h\ 

C\C700\INCLUDBstdlib.h C:\C700\INCLUDE\iostream.h projctn8.h\ 
CAC700\INCLUDBios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDBistream.h C:\C700\INCLUDBostream.h\ 
C:\C700\lNCLUDBmath.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

IZs $(GXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PROJCTN8.sbr PROJCTN8.CPP 

« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXF1_AGS_R) /FRobj\PROJCTN8.sbr PR0JCTN8.CPP 
« 

IENDIF 

obj\COMP_FNC.obj : COMP_FNC.CPP compjnch projctn8.h 
C:\C700\INCLUDE\math.h\ . 

C:\C700\INCLUDE\graph.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\COMP_FNC.obj COMP_FNC.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\COMP_FNC.obj COMP_FNC.CPP 
« 

IENDIF 

obj\COMP_FNC.sbr : COMP_FNC.CPP compjnch projctn8.h 
C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDE\graph.h 
!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFL*GS_D) /FRobj\COMP_FNC.sbr COMP_FNC.CPP 

« 
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!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
^^^G^l7FRobj\COMP - FNC.sbrCOMP_FNC.CPP 

IENDIF 

obj\STRNEW.obj : STRNEW.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\conio.h\ 

C\C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 
CAC700MNCLUDBgraph.h C:\C700\INCLUDEVfloaLh\ 
C:\C700\MFC\INCLUDE\afith C:\C700\INCLUDBfstream.h\ 
C \C700\INCLUDE\time.h mylibmd.h comp_fnc.h cor_fnc8.h\ 
C:\C700\INCLUDE\ctype.h C:\C700\MFC\INCLUDE\afx.inl\ 
C \C700\INCLUDBiostream.h projctn8.h pic_mch8.h res_mch8.h\ 
C\C700\INCLUDBios.h C:\C700\INCLUDE\streamb.h\ 
C \C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
C:\C700\INCLUDBmath.h C:\C700\INCLUDBvmemory.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

lo $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FoobjASTRNEW.obj STRNEW.CPP 
« 

'ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\STRN E W. obj STRNEW.CPP 
« 

IENDIF 

obj\STRNEW.sbr : STRNEW.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\conio.h\ 

CAC700\INCLUDE\stdio.h C:\C700\INCLUDE\strmg.h\ 
CAC700\INCLUDBgraph.h C:\C700\INCLUDBfloath\ 
C:\C70O\MFC\INCLUDE\afx.hC:\C700\INCLUDBfstream.h\ 
C \C700\INCLUDBtime.h mylibmd.h comp_fnc.h cor_fnc8.h\ 
C : \C700\INCLUDBctype.h C:\C700\MFC\INCLUDE\aficinl\ 
C \C700\INCLUDBiostream.h projctn8.h pic_mch8.h res_mch8.h\ 
CAC700\INCLUDBios.h C:\C700\lNCLUDBstreamb.h\ 
CAC700\INCLUDBistream.h C:\C700\INCLUDBostream.h\ 
C:\C700\INCLUDBmath.h C:\C700VINCLUDE\vmemory.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\STRNEW.sbr STRNEW.CPP 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
VZs $(CXXFLAGS_G) 
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$(CXXFLAGS_R) /FRobj\STRNEW.sbr STRNEW.CPP 
<< 

1ENDIF 



obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 
« 

obj\$(PROJ).exe : $(OBJS) 

-$(NMAKEBSC1) MAKEFLAGS= 

-$(NMAKEBSC2) $(NMFLAGS) -f S(PROJFILE) obj\$(PROJ).bsc 
!IF $(DEBUG) 

$(LRF) @«obj\$(PROJ) : Irf 
$(RT_0BJS: = 
) $(OBJS: = +* 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: = 
) + 

$(LLIBS_G: = 
) + 

$(LLIBS_D: = 

$(DEF_F!LE) $(LFLAGS_G) $(LFLAGS_D); 
!ELSE 

$(LRF) @«obj\$(PROJ).lrf 
$(RT_0BJS: = 
) $(OBJS: = 
) 

$@ 

$(MAPFILE_R) 
$(LIBS: = 
) + 

$(LLIBS_G: = +* 
> + 

$(LLIBS_R = + A 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_R); 
« 

IENDIF 

$(LINKER) @obj\$(PROJ).lrf 



.cpp.obj : 

!IF $(DEBUG) 

HS 



SUBSTITUTE SHEET (RULE 26^ 



WO 95/10919 



PCT/US94/01679 



@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_D) /FoS@ $< 

!ELSE 

@$(CXX) @«=obj\S(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FoS@ $< 

IENDIF 

.cpp.sbr : 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
fZs $(CXXFLAGS_G) 
$(CXXFLAGS_D) /FRS@ $< 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FR$@ $< 

IENDIF 



run: obj\$(PROJ).exe 

obj\$(PROJ).exe $(RUNFLAGS) 

debug: obj\$(PROJ).exe 

CV $(CVFLAGS) obj\$(PROJ).exe $(RUNFLAGS) 
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// LINE SELECTION 

// COMMAND STRING 
// 

// lns_corr <TARGET_name> [CommandFile] 
// 

// <TARGET_name> File name of FRAME without extention 

// [CommandFile] Optional ASCI file with a run time parameters. 

// 

// INPUT 

// RGB files of frame (field) and corresponding SGN files created by 

// module PLINE. 

// RUN TIME parameters: 

// 

//fscanf(f," %d %d %d" I &MinSIope,&MaxSlope,&SlopeStep 1 ); 
//SEE ALSO FILE "PLiNes.ini" 
// OUTPUT 

// TARGET_name.stp - all local max lines; 

// TARGET_name.pn2 - lines after cleaning selected; 

// TARGET_name.pln - Strips selected; 

// LINEDET.002 - result collection for analises, 

// includes keyboard information for analyse. 



#include <stdlib.h> 
#include <conio.h> 
#include <stdio.h> 
#include <string.h> 
#include <graph.h> 
#include <float.H> 
#include <afx.h> 
#include <fstream.h> 
#include <time.h> 
#include "mylibmd.h" 
#include "COMP_FNC.h" 
#include "COr_FNC8.h" 
#include <ctype.h> 



short MaxStripNumber= 16; 

short DistanceThresh=10; 

short DetectorWidthPlus=4; 

short MinSlope=-20, MaxSlope=20. SlopeStep=2; 

GOOD_DIR_LINE huge Lines[300]; 

AVERAGE_VEC huge AverageForLines[300]; 

struct _videoconfig vc; 

double GAMMA=1.0,CORR_THRESH=0,Thresh_mdl=0; 
short VOITING=0,MAP=0; 

charf name[40]="J',FILE_name[40]="_". FRAME_Name[40j= 
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PCT pictjarget, target_map; 

void WriteLines(GOOD_DIR_LINE -L,short MaxN, const char -name); 
void WritePears(GOOD_DIR_LINE *L,short MaxN, const char Yiame.short 
PMax); 

int C decl compare_array_elem ( const void *elem1 .const void *elem2 ); 

int lntroduction(int arg, char *a); 

//================================== = = 



ofstream LineC; 



int main(int argc.char* argvQ) 
{short 

char *p,mess[128],clean0=" '• 
if(lntroduction(argc,argv[argc-1])) retum-1 ; 

// PROTOCOL OUTPUT 

// ================ GRAPHICS START 

if(GRAPHICS START(&vc,GRAPHMODE)) GRAPH_OUT(-1 ); 



//========= TARGET PICTURE name and vertexes 

SCR_PNT target_pos(0,0); // CONSTRACTOR default 0,0 
pict_target=sign_storage_rgb(argv[1 ],vc ); 
sign_present_RGB(pictltarget,target_pos); 

SCR_PNT StartPnt(0,0),EndPnt(pict_target.s_cols-1 ,0); 
short Slope, Start, Stop; 
GOOD_DIR_LINE LocalMax[51]; 
//DEBUG 

// GRAPH_OUT(0); 

// LOOP over SLOPE 

for(Slope=MinSlope;Slope<=MaxSlope;Slope+=SlopeStep) 

_settextposition( vc.numtextrows-3,0); 
printf("Slope %d",Slope); 

Start= max(O.-Slope); 

Stop= min(pict_target. s_rows , pict_target. s_rows-S lope); 

// LINE Calculation 

for(EndPnt.r=(StartPnt.r=Start)+Slope; 

S tartP nt.r<Stop; StartPnt. r++, EndPnt.r++) 

{ 

Lines[StartPnt.r]= 
GOOD_DIR_LINE::GOOD_DIR_LINE(StartPnt,EndPnt); 
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AverageForLines[StartPnt.r]=LineMoments(pict_target,Lines[StartPnLr],MAP) 



} 

// Line Estimation 

short StartRow,QO,QUp,QDown; 

for (StartRow=Start;StartRow<Stop- 
DetectorWidthPlus;StartRow++) 

Lines[StartRow].Qual=QuaIity(AverageForLines+StartRow); 

//DEBUG 
#ifdef DBGO 

_clearscreen( _GCLEARSCREEN ); 
sign_present_RGB(pict_target,target_pos); 
for (StartRow=Start;StartRow<Stop-DetectorWidthPlus;StartRow-M-) 

{ _moveto(0, StartRow ); 
_lineto(10,StartRow+Slope+1 ); 
_moveto(255, StartRow+Slope+1 ); 

Jineto(255+(short)(Lines[StartRow].Qual*0.5),StartRow+Slope+1); 
_settextposition( vc.numtextrows-2,0); 
_outtext( clean ); 

_settextposition( vc.numtextrows-2,0); 
sprintf(mesB,"Quality= %6g ",Lines[StartRow].Qual ); 
_outtext( mess);*/ 
} 

getch(); 

#endif 

// Line Selection 

for (QUp=0 I StartRow=_max(0,-Slope); 

StartRow<Stop; StartRow++) 

QO=Lines[StartRow].Qual; 

QDown=(StartRow!=Stop-1)?Lines[StartRow].Qual:0; 
if((Q0>=QDown)&&(Q0>=QUp)) 

{LocalMax[50]=Lines[StartRow]; 

//including in consideration „~,~«r» n. D i hoc 

qsort((void*)LocalMax,51 ,sizeof(GOOD_DIR_LINE 

} ' compare_GOOD_DIR_LINE); 
} 

QUp=Q0; 

}// End Slope LOOP 
CString ProName(argv[1]); 

ProName+=".pln"; 
WriteLines(LocalMax,51 , (const char *)ProName); 
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// line grouping 

PT st_main,end_main,st_scnd.end_scnd; 
for(i=0;i<51;i++) 
if(LocalMax[i].Qual>0) 
{st_main=LocalMax[i].Start_p(); 
end_main=LocalMax[i].End_p(); 
forG=i+1;j<51;j+-»-) 
if(Loca!Max[j].Qual>0) 
{st_scnd=LocalMax[j].Start_p(); 
end_scnd=LocaIMaxQ].End_p(); 
if((fabs(st_main.v-st_scnd.v)<DistanceTriresh)|| 
(fabs(end_,main.v-end_scnd.v)<DistanceThresh)) 
LocalMax[j].Qual=0.0; 

} 

asort((void*)LocalMax,51,sizeof(GOOD_DIR - LINE), 
compare_GOOD_DIR_LINE); 

ProName=argv[1]; 
ProName+=".stp"; 
WriteLines(LocalMax,51 , (const char -)ProName); 
ProName=argv[1 ]; 

ProName+=".pn2"; 

WritePears(LocaiMax,51 , (const char *)ProName, MaxStripNumber); 

GRAPH_OUT(); 

pict_target.free_PCT(); 

return(O); 

} 

// 



int get'nJmber _plines() // INITIALISATION GRAPHICMODE, GET SCALE 
{ 

GRAPH OUT(); nn . ^ 

cou t << " MinSlope -20, MaxSlope 20, SIopeStep2 DistanceThresh 10 

MAP \n"; 

^ NTSC 0 ColorPlanl 1 New_plan 2 RGB 3 LUMlN_THR 4 IHS 5 

\n"; 

cin »MinSlope» MaxSlope»SlopeStep»DistanceThresh»MAP; 

// ================ GRAPHICS START 

if(GRAPHICS_START(&vc.GRAPHMODE)) GRAPH_OUT(-1); 
//================= 

return 1; 
} 
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int get_number_plines_f(FILE T) // INITIALISATION GRAPHICMODE, GET 
SCALE 

{ fscanf(f," %T^]s "); 

fscanf(f," %d %d %d %d 
%d" &MinSlope,&MaxSlope,&SlopeStep I &DistanceThresh, 

&MAP); 

// Threshold for histogramme Number Of Points 
// for CorrThresh 
return 1; 

//==================INTRODUCTION 

int lntroduction(int arg, char "a) 
{ 

int FLG_F=0; 
FILE "datainf; 
short n=0; 
if((arg != 2) && (arg !=3)) 
{ 

printff target-file \n"); 
FLG_F=0; 
return(1 ); 

} 

else 
if(arg ==3) 
{FLG_F=1; 

•rf(!(datainf=fopen(a I ,, r"))) return 0; 
} 

if(FLG_F) 

{get_number_piines_f(datainf); // GET SCALE AND PARAMETERS 
fciose (datainf); 
} 

else 

get_number_plines(); 
return 0; 
} 



II- 



void WriteLines(GOOD_DIR_LINE *l_short MaxN, const char *name) 

LineC.open(name,ios::out || ios::trunc); 
'rf(LineC.failO) 

{LineC.clear(O); 

cout « "CAN NOT OPEN StripCollection"; 
GRAPH_OUT(-1); 

LineC<i" # \t st_X \t st_Y \t end_X Vt end_y \t Value\n"; 
// OUTPUT all 51 line 

15^ 
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short i; 
PT st, end; 

for(i=0;i<MaxN;i++) 

if((L+i)->Qual>0) 

{st=(L+i)->Start_p();end=(L+i)->End_p(); 

LineC« i«" \t"« (short)stu«" \t"«(short)st.v+2« 
" \t"« end.u«" \t"« end.v+2« 
" \t"«(L+i)->Qual«"\n"; 

LineC.close(); 

} _ _ __ ==--=- 

//===================== — =-=-== 



void WritePears(GOOD_DIR_LINE *l_short MaxN, const char Viame.short 
PMax) 

LineC.open(name,ios::oiJtHios::trunc); 
if(LineC.fail()) 

{LineC.clear(0); 

cout « "CAN NOT OPEN StripCollection"; 
GRAPH_OUT(-1); 
} 

LineC«" Strip_Collection \n"; 
//OUTPUT 16 pears 
short i,n=0,j; 
PT st,end,st2,end2; 

for(i=0;i<MaxN-1 ;i++) 
if((L+i)->Qual>0) 

{st=(L+i)->Start_p();end=(L+i)->End_p(); 
for(j=i+1;(n<PMax) && (j<MaxN);j++) 
if((L+j)->Qual>0) 
{n++; 

LineC« (short)stu«" \t"« 

(short)st.v+2«"\t"« end.u«"\t"« end.v+2« , \n'; 
st2={L+j)->Start_p();end2=(L+j)->End_p(); 
LineC« (short)st2.u«" \t"« 

(short)st2.v+2«" \t"« end2.u«" \t"« 



end2.v+2«'\n'; 

} 

LineC.close(); 
} 



} 
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ORIGIN = PWB 
ORIGIN VER = 2.0 
PROJ = LN_DEC2 
PROJFILE = LN_DEC2.mak 
BUILDDIR = obj 
DEBUG = 1 

BRFLAGS = /o obj\$(PR0J).bsc 
BSCMAKE = bscmake 
SBRPACK = sbrpack 
NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
BROWSE =1 
CC =cl 

CFLAGS_G = A/V2 /BATCH /FR$*.sbr /Zn 

CFLAGS_D =/f/Zi/0d 

CFLAGS_R = /f- /Ot /0i /Ol /Oe /Og /Gs 

CXX = cl _. 

CXXFLAGS G = /AL /W4 /G2 /D_DOS /BATCH /FR$*.sbr /Zn 

CXXFLAGS~D = /f- /0d /FPi87 /Zi /DMICI /DSINGLE_WIN /D.DEBUG 

CXXFLAGS_R = /f- /Ot /Ol /Og /Oe /Oi /FPi87 /Gs /DMICI /DSINGLE_WIN 

MAPFlLE_D = NUL 

LT^LAGSjcf =~/NOI /STACK;32000 /BATCH /ONERROR:NOEXE 

LFLAGS_D = /CO /FAR /PACKC 

LFLAGS R = /EXE /FAR7PACKC 

LINKER"" = link 

ILINK = ilink 

LRF = echo > NUL 

[LFLAGS =/a/e 

LLIBS_R = LAFXCR 

LLIBS_D = LAFXCRD 

LLIBS_G = graphics 

CVFLAGS =/25/S 

RUNFLAGS = \ilya\pnewline\tst\t0234e ln_dec.ini 

FILES = \LIBWICALLOC.CPP ..\LIB\PROJCTN7.CPP ..\LIB\PIC_M7.CPP\ 

..\LIB\RES_MCH7.CPP ..\LIB\L_TRN7.CPP LN_TPL1.CPP 
LN DEC2.CPP ,„ u . 

OBJS = objWICALLOC.obj obj\PROJCTN7.obj obj\PIC_M7.obj 
objVRES MCH7.obj\ nr _^ u . 

obj\L TRN7.objobjALN_TPL1.obj obj\LN_DEC2.obj 
SBRS = objvVICALLOC.sbr obj\PROJCTN7.sbr obj\PlC_M7.sbr 
obj\RES MCH7.sbr\ _ ^ 

obj\L_TRN7.sbr obj\LN_TPL1 .sbr obj\LN_DEC2.sbr 

all: obj\$(PROJ).exe 

.SUFFIXES: 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 PCT/US94/01679 

.SUFFIXES: 

.SUFFIXES: .obj .sbr.cpp 

obiWICALLOC.obj : .ALIBWICALLOC.CPP C:\C700\INCLUDBstdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\vmemory.h\ 
C:\C700\INCLUDE\malloc.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 



^CX^CF^GS^.C))^FaQbj\\/ICALLOC.obj .ALIBWICALLOC.CPP 

« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

$(c&^s^ 



IENDIF 



obiWICALLOC.sbr : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDEWmemory.hV 
C:\C700\INCLUDE\malloch 



!IF S(DEBUG) 

@S(CXX) @«obj\S(PROJ).rsp 



^CXX^G^'FRobjAV^ 
1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
^CXXF^G^.RWFRobjWI^ 



IENDIF 



obi\PROJCTN7.obj : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 

' ALIBVP C°\C700\INCLUDBios.h C:\C700\INCLUDE\streamb.h\ 

CAC700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 
C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

$ ( cx^£s^ 

<< 

'.ELSE 

@$(CXX) @«cbj\$(PROJ).rsp 

$ ( cx^laS 
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IENDIF 

obi\PROJCTN7.sbr : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdIib.h C:\C700\INCLUDE\iostream.h 
VLIB\projctn7.h\ 

CAC700\INCLUDBios.h C:\C700\INCLUDE\streamb.h\ 
CAC700\INCLUDBistream.h C:\C700\INCLUDE\ostream.h\ 
C:\C700\INCLUDE\math.h 

MF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PROJCTN7.sbr ..\LIB\PROJCTN7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
fZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\PROJCTN7.sbr ..\LIB\PR0JCTN7.CPP 
« 

IENDIF 

obj\PIC_M7.obj : ..\LIB\PIC_M7.CPP CAC700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\graph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDBio.h C:\C700\INCLUDE\fcntl.h 

C:\C700\INCLUDE\string.h\ 

C\C700\INCLUDBfloat.h C:\C700\INCLUDEWiaIloch ..\LIB\phdr.h\ 
.ALIBWicalloch ..\LIB\pic_mch7.h C:\C700\INCLUDE\vmemory.h\ 
..\LIB\projctn7.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\PIC_M7.obj ..\LIB\PIC_M7.CPP 
« 

IELSE 

@$(CXX) @«objA$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PIC_M7.obj ..\LIB\P1C_M7.CPP 
« 

IENDIF 

obj\PIC_M7.sbr : ..\LIB\PIC M7.CPP C:\C700\INCLUDBstdlib.h\ 
C:\C700\INCLUDBsTdio.h C:\C700\INCLUDBgraph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDBio.h C:\C700\INCLUDBfcntl.h 

C:\C700\INCLUDE\string.h\ 

C \C700\INCLUDE\float.h C:\C700\INCLUDE\malloc.h .ALlB\phdr.h\ 
.ALIBWicalloch .ALIB\pic_mch7.h CAC700\INCLUDE\vmemory.h\ 
.ALIB\projctn7.h 

!1F $(DEBUG) 
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@S(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PIC_M7.sbr ..\LIB\PIC_M7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
fZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\PIC_M7.sbr ..\LIB\PIC_M7.CPP 
« 

IENDIF 

obi\RES MCH7.obj : ..\LIB\RES_MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
C~\C700\INCLUDE\vmemory.h ..\LIB\pic_mch7.h ..\LIB\res_mch7.h\ 
CAC700\INCLUDBgraph.h ..\LIB\projctn7.h C:VC700\INCLUDE\math.h 

!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 

$(C^^G^Dl?FoobjARES_MCH7^bj.ALIB\RES_MCH7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c$(CXXFLAGS G) _ 
$(CXXFLAGS_R") /Foobj\RES_MCH7.obj ..\LIB\RES_MCH7.CPP 

IENDIF 

obj\RES MCH7.sbr:..\LlB\RES_MCH7.CPPC:\C700\INCLUDE\stdlib.h\^ 
C-\C700\INCLUDE\vmemory.h ..\LIB\pic_mch7.h ..\LIB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h ..\LIB\projctn7.h C:\C700\INCLUDE\math.h 

IIF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

IZs $(CXXFLAGS G) 

$(CXXFLAGS_D) /FRobj\RES_MCH7.sbr ..\LIB\RES_MCH7.CPP 
IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
^^F^GS^1"FRabj\RES_MCH7.sbr ..\LIB\RES_MCH7.CPP 

IENDIF 

obi\L TRN7 obi • ..\LIB\L_TRN7.CPP C:\C700\INCLUDE\stdlib.h\ 
_ C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\conio.h\ 

C \C700\INCLUDE\malloc.h .ALIBWicalloc.h ..\LIB\lm_tm7.h\ 

C : \C700\INCLUDE\vmemory.h ..\LIB\projctn7.h ..\LIB\res_mch7.h\ 

..\LIB\pic_mch7.h C:\C700\INCLUDE\math.h 
C:\C700\INCLUDE\gr2ph.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
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/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\L_TRN7.obj ..\LIB\L_TRN7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\L_TRN7.obj ..\LIB\L_TRN7.CPP 
!ENDIF 

obj\L TRN7.sbr : ..\LIB\L_TRN7.CPP C:\C700\INCLUDBstdIib.h\ 
~~ C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\conio.h\ 

C:\C700\INCLUDE\malloc.h .ALIBWicalloc.h .ALIB\lin_trn7.h\ 

C:\C700\INCLUDBvmemory.h ..\LIB\projctn7.h ..\LlB\res_mch7.h\ 

.ALIB\pic_mch7.h C:\C700\INCLUDE\math.h 
C:\C700\INCLUDE\graph.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\L_TRN7.sbr .ALIB\L_TRN7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRob]\L_TRN7.sbr .ALIB\L_TRN7.CPP 
« 

IENDIF 

obj\LN_TPL1.obj : LN_TPLT.CPP CAC700VINCLUDBstdio.h 

CAC700\INCLUDBstd!ib.h\ 

CAC700\INCLUDBconio.h C:\C700\INCLUDE\malloah\ 
CAC700\INCLUDE\float.hCAC700\INCLUDE\graph.h\ 
CAC700\INCLUDE\string.h CAC700VINCLUDBctype.h match5.h\ 
.ALIB\pic_mch7.h ..\LIB\projctn7.h .ALIB\res_mch7.h\ 
.ALIB\lin_tm7.h CAC700\INCLUDBvmemory.h 

C:\C700\INCLUDBmath.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\LN_TPL1 .obj LN_TPL1.CPP 

« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\LN_TPL1.obj LNJTPL1.CPP 
« 

IENDIF 
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obj\LN_TPL1.sbr : LN_TPL1.CPP C:\C700\INCLUDE\stdio.h 

C:\C700\INCLUDE\stdlib.h\ 

C \C700\INCLUDE\conio.h C:\C700\INCLUDE\maIloc.hA 
C \C700\INCLUDBfIoath C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\string.h C:\C700\INCLUDE\ctype.h match5.h\ 
..\LIB\pic_mch7.h ..\LIB\projctn7.h ..\LIB\res_mch7.h\ 
..\LIB\lin_trn7.h C:\C700\INCLUDE\vmemory.h 

C:\C700\INCLUDE\math.h 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\LN_TPL1 .sbr LN.TPL1 .CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\LN_TPL1 .sbr LN_TPL1.CPP 
!ENDIF 

obj\LN_DEC2.obj : LN_DEC2.CPP C:\C700\INCLUDE\stdlib.h 

C:\C700\INCLUDE\conio.h\ 

C:\C700\lNCLUDE\stdio.h C:\C700\INCLUDE\string.h\ 
C:\C700\INCLUDE\graph.h C:\e700\INCLUDE\float.h\ 
C:\C700\MFC\INCLUDE\afx.h C:\C700\INCLUDBfstream.h\ 
C:\C700\INCLUDE\time.h match5.h „\L!BVvicalloc.h\ 
C:\C700\INCLUDE\ctype.h C:\C700\MFC\INCLUDE\afxJnl\ 
C \C700\INCLUDE\iostream.h ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
ALlB\res_mch7.h ..\LIB\lin_tm7.h C:\C700\INCLUDE\vmemory.h\ 
C:\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700VINCLUDE\istream.hCAC700\INCLUDE\ostream.h\ 
C:\C700\INCLUDE\math.h 

!IF$(DEBUG) 

@$(CXX) @«bbj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\LN_DEC2.obj LN_DEC2.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\LN_DEC2.obj LN_DEC2.CPP 
« 

IENDIF 

obj\LN_DEC2.sbr : LN_DEC2.CPP C:\C700\INGLUDE\stdlib.h 

C-\C700\INCLUDE\conio.h\ 

C \C700\INCLUDE\stdio.h C:\C700\INCLUDE\stnng.h\ 
C \C700\INCLUDE\graph.h C:\C700\INCLUDE\float-h\ 
C \C700\MFC\INCLUDE\afx.h C:\C700\INCLUDE\fstream.h\ 
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C \C700\lNCLUDBtime.h match5.h ..\LIB\vicalloch\ 
C- CTOOUNCLUDBctype.h C:\C700NMF(^NCLUD^.nJ 
C-\C700\INCLUDBiostream.h ..\L!B\projctn7.h ..\LIB\pic_mch7.h\ 
iSSSs mch7.h ..\LlB\lin_tm7.h C:\C700\INCLUDBvmemory.h\ 
C-\C700UNCLUDEVioa.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 

C:\C700\INCLUDE\math.h 



UF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 



^«F^.Dl"WN_DEC2.sbr LN.DEC2.CPP 

« 

• ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) _ 
$(CXXFLAGS_R) /FRobj\LN_DEC2.sbr LN_DEC2.CPP 



IENDIF 



obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 



obj\$(PROJ).exe : $(OBJS) 

!IF$(DEBUG) 

$(LRF) @«obj\S(PROJ).lrf 
$(RT_OBJS: = 
) $(OBJS: = +* 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: - 
) + 

$(LL!BS G: = +^ 
) + 

$(LLIBS_D: = + A 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_D); 
« 

!ELSE 

S(LRF) @«obj\S(PROJ).lrf 
$(RT_OBJS: = + A 
) $(OBJS: = + A 
) 
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$(MAPFILE_R) 
$(LIBS: = 
) + 

$(LLIBS_G: = ■+* 
$(LL!BS_R: = + A 

$(DEF_FILE) $(LFLAGS_G) S(LFLAGS_R); 
« 

IENDIF 

$(LINKER) @obj\$(PROJ).lrf 



.cpp.obj : 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_D) /FoS@ $< 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
Jc $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FoS@ $< 
« 

IENDIF 

.cpp.sbr : 

IIF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFI_AGS_G) 
$(CXXFLAGS_D) /FRS@ $< 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 
$(CXXFLAGS_R) /FRS@ $< 
« 

IENDIF 



run: obj\$(PROJ).exe 

obj\$(PROJ).exe S(RUNFLAGS) 

debug: obj\$(PROJ).exe 

CV $(CVFLAGS) obj\S(PROJ).exe $(RUNFLAGS) 
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#ifndef MATCH 
#defme MATCH 
#indude "projctnZ.h" 
#include **pic_mch7.h" 
#include "res_mch7.h" 
#include M lin_trn7.h" 
//#include "tem_plt7.h" 



#define NAME_LENGTH 40 

#def.ne GRAPHMODE _VRES256COLOR 

//COLOR_RGB INTER_pix_color_rgb(PCTp1. PT PT_now); 
#endif 
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// STRIP SELECTION 

// Module gets a strips after line detection (module phnes 
// and selects two lines with a maximumm informational 
// contents (frequency approach). 
// COMMAND STRING 

// lns_corr <TARGET_name> [CommandFile] 

// <TARGET_name> File name of FRAME without extention 

// * [CommandFile] Optional ASCI file with a run time parameters. 

// 

// INPUT 

//=======ATTENT10N 

// LN DEC2used .pn2 files - output PLNEW modules 

// RGB files of frame (field) and corresponding -SGN files created by 

// module PLINE. 

// RUN TIME parameters: 

// <fournumber> ^shift of strips vertexes relative to original 

// <V HJow H_up Hight Width> -Five integer. 

// V - The highest vertical harmonic; 

// H low, H_up -The lowest and highest horisontal harmonics; 

// Hight, Width - Hight and Width of windowfor analyses. 

// <Gap HalfScrWeight PosWeight> - Integer and two float <1 : 

II G a p - range unsensetivites to screen position; 

// HalfScrWeight - Additional weght if an upper line is 

// in upper half of screen 

// PosWeight - Additional weght if miuddle line belower 

II then middle line of another line. 

//SEE ALSO FILE "LN_DEC. Ini" 

// OUTPUT 

// TARGET_name.SG2 - Strips selected; 

// LINEDET.002 - result collection for analyses, 

// includes keyboard information to analyse. 

//=======ATTENTION 

// LN DEC2 OUTPUT 

// ~TARGET_name.SG2 - Strips selected; 

// LINEDET.002 - result collection for analyses, 

II includes keyboard information to analyse. 

#include <stdlib.h> 
#include <conio.h> 
#include <stdio.h> 
#include <string.h> 
#include <graph.h> 
#include <float.H> 
#include <afx.h> 
#include <fstream.h> 
. #include <time.h> 
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#include "match5.h" 
#include "vicalloc.h" 
#include <ctype.h> 

short PRESENT_HIGHT; 
short GAP=8; 

double HalfScrWeight=0.1, PosWeight=0.1; 

short TAG_hight; 
stru£t _yideoconfig vc; 
SCR_PNT vrt_target[4]; 
FILE -datres; 
double sh[4]={0,0,0,0}; 

double GAMMA=1 .0,CORR_THRESH=0,Thresh_mdl=0; 
short VOITING=0,MAP=0; 

char f_name[40]="J , .f r ILE_name[40]= ,, _ M , FRAME_Name[40]="__", 

STRING_name[40]="_". SIGN_name[40]="_"; 
PCT pict_target, target_map; 
short win_hight,win_lertth; 

short H0R_HARM_l,H0R_HARM_h,VERT_HARM_1 ; 

int cded compare_array_elem ( const void *elem1 .const void *elem2 ); 

int Picturelnf(const char *name,SCR_PNT *vertexes, short n); 

//int picture inf_num_new(char "name,SCR_PNT *vertexes, short n); 
void get_shift_f(FILE f .double - sh); // INITIALISATION GRAPHICMODE, 
GET SCALE 

void get_shift(double "sh); // INITIALISATION GRAPHICMODE, GET SCALE 

int get_number_3(); 

int get_number_3_f(FlLE *f); 

double GlobalWinCalc(PCT target_map, 

SCR_PNT win_size, short winpos); 
//================================================= == = 



of stream LineC; 

//============ OpenStripCollection 

void OpenStripCol(const char'name) 
{LineC.open(name,ios::out|ios::app|ios::out|ios::nocreate); 

if(LineC.fail()) 
{LineC. clear(O); 

LineC.open(name,ios::out|ios::appiios::out|ios::noreplace); 

if(LineC.fail()) 
{LineC clear(O); 

cout « "CAN NOT OPEN StripCol lection"; 
GRAPH_OUT{-1); 
} 

.else • . 

LineC«"StripAnalysCollection \n"; 

•; ;.} / . 

16b 
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UneC«"Name #1\tVERT_HARMJ YT« 

" H0R_HARM_l \t H0R_HARM_h \t WmdowLength\n ; 

int main(int argc.char* argvfl) 

char -p,mess[128],cleanQ=" : 

SCR PNT line_vrt[20][4]; 

int FLG_F=0; 

FILE "datainf; 

short n=0; 

SCR_PNT t _pos; 

if((argc != 2) && (argc !=3)) 

printf(" target-file \n"); 
FLG_F=0; 
retum(1); 

} 

else 
rf(argc =3) 
{FLG_F=1 ; 

if(!(datainf=fopen(argv[2],"r))) return 0; 
} 

if(FLG_F) _ r- 

{get_shift_f(datainf,sh); // GET SCALE 
get_number_3_f(datainf); 
} 

else 

{get_shift(sh); // GET SCALE 
gefnumber_3(); 

// PROTOCOL OUTPUT 
CString ProName(Tinedet.u02"); 
strcpy(f_name,argv[1]); 

~ «HOR HARM_h«"\r«win_lenth«Vi; 
LineC«"GAP="« GAP« "\tHalfScrWeight="«HalfScrWe.ght« 

" \tPosWeight= "«PosWeight« "VY; 
LineC«" Line # \t Hight \t Value \t Comm \n"; 
// ================ GRAPHICS START 

if(GRAPHICS_START(&vc,GRAPHMODE)) GRAPH_OUT(-1 ); 

// ™__ ==== TARGET PICTURE name and vertexes 
SCR_PNTtarget_pos; // CONSTRACTOR default 0,0 
pict target=sign_storage_rgb(argv[1],vc); 

//========= PROTOTYPE initialisation 

short j.k; . 

/an 
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double res[20]; 
forG=0;j<20;res[j++]=0.0); 
CString FNamef ',80); 

FName=argv[1]; 

FName+=".pn2"; 
while(Picturelnf((const char*)FName,vrt_target, n++)) 

SCR_PNT vrt[4]; 
match_vertex( vrtjarget); 
forG=0;j<4;j++) 

vrtD].c=vrt_targetQ].c; 
k=(G%2)?j-l:j+l); 

tf {vrt01 S r=^shD]?(short)((vrtJargetO].r-vrt_target[k].r)*sh[j])+ 
vrt_targetQ].r.vrt_target[j].r); 
} 

else 

vrt03.r=vrt_target[fl.r+sh[j]; 

} 

#define CALC_HIGHT 16 n 

TAG_hight=(short)(vrt[2]-r-vrt[3]. r+vrt[1 ].r-vrt[0].r+2)«u.5, 
if(TAG_hight<10) continue; ( HirHTV 

target_map=linearjransform_cont(pict_target, vrt, CALC.HIGHT ), 

if(!target_map.s_cols) . 

{printf('TOO NARROW LINES");continue;} 
match_vertex( vrt); 

PRESENT_HIGHT=16; 
_clearscreen(_GCLEARSCREEN); 
target_pos.c=10; 
target_pos.r=10; 

sign_present_RGB( target_map,target_pos); 

SCR_PNT win_size( 128,4); 
short winpos; 

win size.r=(win_hight>0)?_min(win_hight,CALC_HlGHT):CALC_HIGHT ; 
" win_size.c=(winJenth>0)?__min(winJenth,target_map.s_cols) 
:target_map. s_cols; 
winpos=( CALC_H IGHT-win_size.r)/2; 

const double scale=(double)PRESENT_HIGHT/CALC_HIGHT; 
// RESULTS AND VERTEXES .... 

res[n-1]= GlobalWinCalc(target_map,win_size, winpos); 

for O=0;j<4;j++) 

line_vrt[n-1]D]=vrtQl; 

target_map.free_PCT(); ^ 

//___===-===-=--==========-====—= = 
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LineC« n-1«" \t"« TAG_hight«" \t"« res[n-1]«" \t"; 
//LineC«" Line # \t Hight \t Value \t Comm_1 \t COMM_2 \n"; 

sprintf(mess,"File Name "); 

_settextposition( vc.numtextrows-2,0); 

_outtext( clean ); 

_settextposition( vc.numtextrows-2,0); 
~outtext( mess ); 
p=mess; 

while(!isspace( (int)( w p++=(char)getche()) )); 
•(-p)='\0'; 

LineC«mess«"\t\n"; 

//=================================—= =-== 

111 DECISIONMAKING 

short i,nl[5], up_ln[5],topJn[5]; 
short best=0,scnd=0; 

double *nmb[20],weight[5]={0,0,0,0,0}; 

for(i=0;i<20;i++) nmb[i]=res+i; 
qsort((void*)nmb,20,sizeof(double*),compare_array_elem ); 

for(i=0;i<5;i+-t-) 
{if(!(*nmb[i])) break; 
nl[i]=nmb[i]-res; 

up_ln[i]=line_vrt[nl[il][3].r+line_vrt[nl[i]][0].r 
top_ln[i]=line_vrt[nl[i]][2]. r+line_vrt[nl[i]][2].n 
weight[i]=*nmb[i]; 
} 

if(weight[0]) 

{if((up ln[1 ]+top_ln[1 ])>(upJn[0]+top_ln[0]-GAP)) 

weight[1 ]-=(1 -0+PosWeight); 
if(up ln[1l>pict target. s_rows) 

weight[1 ]*=(1 -O+HalfScrWeight); 

if(up lh[01>pict target.s_rows) 

" weight[0]*=(1.0+HalfScrWeight); 

scnd=(best=(weight[0]<weight[1])?1 :0)?0:1 ; 

// DESCISION OUTPUT 

target_pos.c=10; 
target_pos.r=10; 

clearscreen(_GCLEARSCREEN); 
target_map=linear_transform_cont(pict_target, line.vrtfnirbest]], 1 6 ); 
sign_present_RGB( target_map,target_pos); 
target_map.free_PCT(); 

if(weight[scnd]) 

{ ^ osr+ - 20 . 

targetZm°ap=lineaV_transform_cont(picU^ line_vrt[nl[scnd]], 1 6 ); 
sign_present_RGB( target_map,target_pos); 
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target_map.free_PCT(); 

sprintf(mess. "Result 1_res= %6g w= %6g 2_res=%6f W=%6f \0". 
•nmbCbestl.weightfbestl^nmbtscndl.weighttscnd]); 

char Sn1[20]; 

_settextposition( vc.numtextrows-2, 1 ); 
~outtext( clean ); 

_settextposition( vc.numtextrows-2,0); 
~outtext( mess ); 
p=Sn1; 

while(!isspace( (int)(*p++=(char)getche()) )); 

strcat(mess,Sn1); 
LineC« mess«'\n'; 
LineC.close(); 
//picture presentation 
_clearscreen(_GCLEARSCREEN); 
target_pos.c=0; 
target_pos.r=0; 

target_map=linear_transforrn_cont(pict Jarget, iine_vrt[nl[best]], 1 6 ); 

sign_present_RGB( pict_target,target_pos); 
_setcolor( color_num(240.240,240)); 
_moveto(line_vrt[nl[best]][3].c,!ine_vrt[nl[best]][3].r); 
Jineto(line_vrt[nl[bestlO].c,!ine_vrt[nl[best]][0].r); 
_moveto(line_vrt[nl[best]l[2].c,iine_vrt[nl[best]][2].r); 
Jineto(line_vrt[nl[best]][1].c,Iine_vrt[nl[best]][1].r); 
getch(); 

if(weight[scnd]) 

_setcolor( color_num(240,240,0)); 

_moveto(line_vrt[nl[scnd]][3].c,line_vrt[nl[scnd]][3].r); 

Jineto(line_vrt[nl[scnd]][O].c l line_vrt[nl[scnd]][0].r); 

_moveto(Iine_vrt[nl[scnd]][2].c,line_vrt[nl[scnd]][2].r); 

_lineto(line_vrt[nl[scndni].c,line_vrt[nl[scnd]][1].r); 

getch(); 

} 

strcat(strcpy(f_name > argv[1]) l ".sg2"); 
LineC.open(f_name,ios::out); 
LineC«"After Str Selection^"; 

LineC«argv[1 ]«" "«Sn1 «" \t" «Sn1 «'\n'; 

forG=0;j<4;j++) 

LineC«line_vrt[nl[best]]0].c« ,, Vt"«line_vrt[nl[best]][j].r« , \n; 
if(weight[scnd]) 
for(j=0;j<4;j++) 

LineC«line_vrt[nl[scnd]]D].c«"\t"«line_vrt[nl[scnd]]D].r« , \n'; 
LineC.close(); 
// END DECISION 
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} 

else 

^ LineC.open(f_name,ios::out); 
LineC«"After Str Selection\n"; 

LineC«argv[1]«" "«" \t * 

LineC.closeO; 

cout «" Lines not proposed"; 
} 

GRAPH_OUT(); 

pict_target.f ree_P CT(); 

target_map.free_PCT(); 

fclose(datres); 

return(O); 

} 



//==========================-=-=-= ~ 

iri"~cded com"pare_array_elem ( const void *elem1 .const void "elem2 ) 
{int i; 
double a; 

a=**(double **)elem1 -"(double **)elem2; 
j=(a?((a<0)?1:-1):0); 
return i; 
} 

// _ 



void get_shift_f(FILE f.double • sh) // INITIALISATION GRAPHICMODE. 
GET SCALE 

{ fscanf(f," %lf %lf %lf %lf '.sh.sh+1 ,sh+2,sh+3); 

} 

// . 



v"oid getlhifKdouble - sh) // INITIALISATION GRAPHICMODE. GET SCALE 

{ ' nt '' cout« "vertexes shift over rows ( top_right, bottom.right, bottomjeft. 
topjeft %\n"; 

for (i=0;i<4; 

cin»sh[i]; 

} ==-=-================= 

//==================== = 



int get_number_3() 
{ 

GRAPH_OUT(); 

11 i 
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cout « " VERT_HARM<16 HOR_HARM_start<16 
HOR_HARM_stop,win_hight winjenth"; 

>twRT_HARM_1>>H0R_HARMJ>>H0R_HARM_h>>v^n_hight>>win_lent 

OTut«" GAP HalfScrWeight % PosWeight % "; 

cin»GAP»HaifScrWeight»PosWeight; 

HalfScrWeight/=1 00.0; 

PosWeight/=100.0; mrVT - 
// ================ GRAPHICS START 

if(GRAPHICS_START(&vc,GRAPHMOD£)) GRAPH_OUT(-1 ); 
//================= 

return 0; 
} 

// 

intget number_3_f(FlLE *f) 
(fscanlfryodyod'/odyodyod-.&VER^HARMJ, 

&HOR HARM_l.&HOR_HARM_h,&win_hight,&winJenth), 

fscanf(f," %d %lf %|f , .&GAP I &HalfScrWeight,&PosWeight); 

HalfScrWeight7=1 00.0; 

PosWeight/=1 00.0; 
return 1 ; 

} 

II 



int Picturelnf(const char 'name.SCR.PNT -vertexes, short n) 

{intij; 
ifstream datfp; 

char new_str[80]; 

int r,FLG=0; 

datfp.open(name,ios::in); 
if(datfp.fail()) 

{datfp. clear(O); 

cout « "CAN NOT OPEN InfFiie "« name«Vi ; 
GRAPH_OUT(-1); 
} 

datfp.getline(new_str,80); 

for(j=0;j<n+1;j++) 

for(i=0;i<4;i++) 

{datfp»(vertexes+i)->o>(vertexes+i)->r 1 

if(datfp.eof()) 

{datfp.close (); return 0;} 

} 

datfp.close (); 
return 1 ; 
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#include <stdio.h> 
#include <stdlib.h> 
#include <conio.h> 
#include <malloc.h> 
#include <float.h> 
#include <graph.h> 
#indude <string.h> 
#include <ctype.h> 

#include "match5.h" 
//#include "tem_plt7.h" 
#include "pic_mch7.h" 
#defineMAX_L!NE1024 



extern short TAG_hight; 
extern struct _videoconfig vc; 

extern char f_name[40],FILE_name[40l, FRAME_Name[40], 

STR!NG_name[40], SIGN_name[40]; 
typedef struct 

{double md[3],var[3];} AVERAGE_VEC, ^ 
//================================= =-== === 



extern short HOR_HARM_l; 
extern short HOR_HARM_h; 
extern short VERT_HARM_1 ; 

double calcul_power(PCT win.short x_scale, double *vr) 

{const short 

VERT HARM=VERT_HARM_1 "2,H0R_HARM=H0R_HARM_h*2, 

" HOR_HARM_s=HOR_HARMJ?HOR_HARM_!-2-1 :HOR_HARM_l; 

const short THR=16; 
double sum[19][ 19]; 
COLOR_RGB col; 
double pow=0,mid=0; 
short d ; 
long l_now; 
long n; 

short hJ,v_t I x,y,h,v 1 haIf_x,half_y,quot_x,quot_y, 

n=win.s_cols"win.s_rows; 

half_y=win.s_rows»1 ; 

quot_y=win. s_rows»2; 
//!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!'•!!!!!!!!!!!!!!!>!!!!!!!!!!!!!!!!!!! 

half_x=x_scale»1 ; 

quot_x=x_scale»2; 
// half_x=win.s_rows»1; 
// quot_x=win.s_rows»2; 
// halfJx=win.s_cols>>1; 
// quot x=win.s_cols»2; 

//!!!!!!!!!!m!!!!!!!n!!!!!!!!!!! 1 .!!!! !!M!!!!!!!!!!!!!!!!!!M!!H!!!! 
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for(h=0;h<HOR_HARM+1 ;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 
sum[v][h]=0; 
f or(y=0;y<win. s_rows:y++) 
for(x=6;x<win.s_cols;x++) 
{col=win.get_oixel(y,x); 
l_now=col.r+col.b+col.g; 
Lnow=(l_now>THR)?(_now:0; 
mid+=l_now: 
dow+=I now*1 now; 

for(v=0Uv<VERT_HARM+1 ) &&(((v+1 )»1 )<=quot_y);v++) 

{ v t =y*( (v+ i)»1); // HARMONIC #=(v+1)»1 
v t=(v_t+(v & 0x0001 ? quot_y:0))/half_y; 
v~t &= 0x0001; //1 if y_P°s in 2nd half 
c1= v_t?l_now:-l_now, 

for(h=HOR_HARM_s;(h<HOR_HARM + 1)&&(((h+1)»D<=quot_x);h-HH) 
*h_t=x*((h+1)»1); 

h_t=(h_t+(h & 0x0001 ?quot_x:0))/haH_x; 
h_t &=~0x0001 ; 
sum[v][h]+= h_t?d:-cl; 
} 

} 

} 

double sO.dd; 

for(sO=h=0;h<HOR HARM+1;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 
if(h||v) 

sO+=(double) sum[v][h]*sum[v][hj; 

sO/=n; 

*vr=(dd=(pow-mid-mid/n))?sO/dd:0; 
//return add_out; 
return (s0/(n*1 00.0)); 

double GlobalWinCalc(PCTtarget_map, 

SCR_PNT win_size, short winpos) 

{ 

double centr_pow, 
double pow_now; 
long n_fr=0; 
double mid_pow=0; 
double rev_fn 

PCTwin(wn_size.c,win_size.r); 
SCR_PNT st_t,st_win; 
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st_win.r=winpos; 

for (st_win.c=0;st_win.c<target_map.s_cols-win_size.c+1 ;st_win.c++) 

^win.load_template(target_map,st_win); 
pow_no\A^calajl_^ower(win,target_map.s_rows,&centr_pow); 
mid_pow+=pow_now, 
n_fr++; 
} 

rev_fr=1.0/n_fn 
mid_poW=rev_fr; 

win.free_PCT(); 
return mid_pow; 

} 

//============================== 
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ORIGIN = PWB 
ORIGIN_VER = 2.0 
PROJ = LNS_CORR 
PROJFILE = LNS_CORR.MAK 
BUILDDIR = obj 
DEBUG = 0 

BRFLAGS = lo obj\$(PROJ).bsc 
BSCMAKE = bscmake 
SBRPACK = sbrpack 
NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
BROWSE = 1 
CC =cl 

CFLAGS_G = /W2 /BATCH /FR$*.sbr/Zn 
CFLAGS_D =/f/Zi/Od 
CFLAGS_R = /f- /Ot /Oi /Ol /Oe /Og /Gs 
CXX =cl 

CXXFLAGS_G = /AL /W4 /G2 /D_DOS /BATCH /FR$*.sbr /Zn 
CXXFLAGSJD = /f- /Od /FPi87 fZ\ /DMICI /DSINGLE_WIN 
CXXFLAGS_R = /f- /Ot /Ol /Og /Oe /Oi /FPi87 /Gs /DMICI /DSINGLE_WIN 
MAPFILE_D = NUL 
MAPFILE_R = NUL 

LFLAGS_G = /NOI /STACK:32000 /BATCH /ONERROR:NOEXE 

LFLAGS_D = /CO /FAR /PACKC 

LFLAGS_R = /EXE /FAR /PACKC 

LINKER =Iink 

ILINK = ilink 

LRF = echo > NUL 

ILFLAGS =/a/e 

LLIBSJ3 = graphics lafecr 

CVFLAGS =/25/S 

RUNFLAGS = ..\win4\S160_0 „\wir»4\S160_ autol 

FILES = LNS_CORR.CPP ..\LIBWICALLOC.CPP ..\LIB\PROJCTN7.CPP\ 

„\L!B\PIC_M7.CPP ..\LIB\RES_MCH7.CPP COR_FNC.CPP 
COR_WlN.CPP 

OBJS = obj\LNS_CORR.obj objAVICALLOC.obj obj\PROJCTN7.obj 
obj\PIC_M7.obj\ ~ 

obj\RES_MCH7.obj obj\COR_FNC.obj obj\COR_WIN.obj 
SBRS = obj\LNS_CORR.sbr objWICALLOC.sbr obj\PR0JCTN7.sbr 
obj\PIC_M7.sbr\ 

obj\RES_MCH7.sbr obj\COR_FNC.sbr obj\COR_WIN.sbr 

all: obj\$(PROJ).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .obj .sbr .cpp 



lib 
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obj\LNS_CORR.obj : LNS_CORR.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\conio.h C:\C700\INCLUDE\stdio.h\ 
C:\C700\INCLUDE\string.h C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\fIoat.H C:\C700\INCLUDE\io.h 

C:\C700\INCLUDE\time.h\ 

C:\C700\INCLUDE\ctype.h C:\C700\INCLUDBiostream.h\ 
C:\C700\MFC\INCLUDE\afxh LNS_CORR.h cor_win.h 

c:\iIya\lib\vicalIoc.h\ 

C:\C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 
C:\C700\MFC\INCLUDE\afx.inl ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
.ALIB\res_mch7.h c:\ilya\lib\lin_tm7.h C:\C700\INCLUDE\vmemory.h\ 
C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\S(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\LNS_CORR.obj LNS_CORR.CPP 

« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\LNS_CORR.obj LNS_CORR.CPP 
IENDIF 

objALNS_CORR.sbr : LNS_CORR.CPP C:\C700\INCLUDE\stdIib.h\ 
C:\C700\INCLUDBconio.h C:\C700\INCLUDE\stdio.h\ 
C:\C700\lNCLUDBstring.h C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDBfloatH C:\C700\INCLUDBio.h 

C:\C700\INCLUDE\time.h\ 

C:\C700\INCLUDBctype.h C:\C700\INCLUDE\iostream.h\ 
C:\C700\MFC\INCLUDE\afx-h LNS^CORR.h cor_win.h 

c:\ilya\lib\vicalloch\ 

C:\C700\INCLUDBios.h C:\C700\INCLUDE\streamb.h\ 
C:\C700MNCLUDBistream.hC:\C700\INCLUDBostream.h\ 
C:\C700\MFC\INCLUDBafxJnl ..\L!B\projctn7.h ..\LIB\pic_mch7.h\ 
..\LIB\res_mch7.h c:\ilya\lib\lin_trn7.h C:\C700\INCLUDBvmemory.h\ 
C:\C700\INCLUDBmath.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRcbj\LNS_CORR.sbr LNS_CORR.CPP 
IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\LNS_CORR.sbr LNS_CORR.CPP 
« 
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obiWICALLOC.obj : .ALIBWICALLOC.CPP C:\C700\lNCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDBvmemory.h\ 
C:\C700\INCLUDE\malloch 

!!F $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

$ C (C&^^D^FoobjWICALLOC.obj.ALIB\VlCALLOC^ 
<< 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

<< 

1ENDIF 

objWICALLOC.sbr : .ALIBWICALLOC.CPP C:\C700\INCLUDBstdlib.h\ 
CAC700\INCLUDE\stdio.h C:\C700\lNCLUDEWmemory.h\ 
CAC700\INCLUDE\malloc.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs S(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) , ^ Mn 

$(CXXFLAGS_R) /FRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

1ENDIF 

ob.APROJCTN7.obj : ..\LIB\PR0JCTN7.CPP C:\C700\INCLUDE\graph.h\ 
CAC700\INCLUDE\stdlib.h CAC700\INCLUDE\iostream.h 

..\LIB\projctn7.h\ n 

C \C700\INCLUDE\ios.h CAC700\INCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h CAC700\INCLUDBostream.h\ 
CAC700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

<< 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 

$(C^^^R)^ocbj\PROJCTN7.obj ..\LIB\PR0JCTN7.CPP 
« 

IENDIF 

IIS 

SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



obj\PROJCTN7.sbr : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostrearn.h 

..\LIB\projctn7.h\ ^ 

C \C700\INCLUDE\ios.h C:\C700VINCLUDE\streamb.h\ 
C:\C700\INCLUDE\istream.h C:\C700\INCLUDBostream.h\ 
C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@S(CXX) @«cbjA$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRcbj\PROJCTN7.sbr ..\LIB\PROJCTN7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
^C^F^G^KFRobj\PROJCTN7.sbr..\LIB\PROJCTN7.CPP 
« 

IENDIF 

obi\PIC M7obi : ..\LIB\PIC_M7.CPP C:\C700\INCLUDBstdiib.h\ 
C:\C700\INCLUDBstdio.h C:\C700\INCLUDE\graph.h 

C\C700\INCLUDE\math.h\ 

C:\C700\INCLUDBio.h C:\C700\INCLUDBfcntl.h 

CAC700\INCLUDE\string.h\ wj 

C \C700\INCLUDBfloat.H C:\C700\INCLUDE\maIloc.h ..\LIB\phdr.h\ 
c:\ilya\libWicallach ..\LIB\pic_mch7.h C:\C700\INCLUDE\vmemory.h\ 
„\LIB\projctn7.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\PIC_M7.obj ..\LIB\PIC_M7.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c$(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PIC_M7.obj ..\LIB\PIC_M7.CPP 
« 

IENDIF 

obiXPIC M7 sbr : ..\LIB\PIC_M7.CPP C:\C700\INCLUDBstdlib.h\ 
C:\C700\INCLUDBstdio.h C:\C700\lNCLUDE\graph.h 

C:\C700\lNCLUDE\math.h\ 

C:\C700\INCLUDBio.h C:\C700\INCLUDE\fcntl.h 

CAC700\INCmDBstnng^h\^ H 

c:\ilya\IibWicalloch ..\LIB\pic_mch7.h C:\C700\INCLUDE\vmemory.h\ 
..\LIB\projctn7.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
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^j«F^GSJ)l7FRobj\PIC_M7.sbr ..\LIB\PIC_M7.CPP 
« 

!ELSE 

@$(CXX) @«obj\S(PROJ).rsp 

^C^F^G^7FRobj\PIC_M7.sbr ..\LIB\PIC_M7.CPP 
« 

IENDIF 

obi\RES MCH7.obj : ..\LIB\RES_MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
C~\C700\INCLUDE\vmemory.h ..\LIB\pic_mch7.h ..\LlB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h .ALIB\projctn7.h C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«objA$(PROJ)-rsp 

$(c£^^D) ( /Foabj\RES_MCH7.obj ..\LIB\RES_MCH7.CPP 

« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
$(C&^^%?FoobjARES_MCH7.obj.ALlB\RES_MCH7.CPP 



obj\RES MCH7.sbr: .AL!B\RES_MCH7.CPP C:\C7^NCWDBb^W 

C _ \C700\INCLUDE\vmemory.h ..\LIB\p.c_mch7.h ^^f-™^ 7 ™ . 
CAC700\INCLUDE\graph.h .ALIB\projctn7.h CAC700\INCLUDE\math.h 

!IF S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^CXXF^GS^^~FRobjARES_MCH7.sbr .ALIB\RES_MCH7.CPP 
!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

« 

•ENDIF 

obj\COR_FNC.obj : COR_FNC.CPP CAC700\INCLUDBstdio.h 

C \C700\INCLUDE\stdlib.h\ 

CAC700MNCLUDE\conio.h CAC700\INCLUDBfloat.H\ 
CAC700\INCLUDE\graph.h corjnc.h .ALIBVpic_mch7.h 

.ALIB\res_mch7.h\ ' . 

CAC700\INCLUDE\vmemory.h .ALIB\projctn/' .n 

CAC700\INCLUDE\math.h 
!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
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$(C&^^D)?Foobj\COR_FNC.objCOR_FNC.CPP 
<< 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
$(C>a^^%^Foobj\COR_FNC.objCOR_FNC.CPP 
« 

lENDIF 

obj\COR_FNC.sbr : COR.FNC.CPP C:\C700\INCLUDE\stdio.h 

C\C700\INCLUDE\stdIib.h\ 

C \C700\INCLUDBconio.h C:\C700\INCLUDE\float.H\ 
C:\C700\INCLUDBgraph.h corjnc.h ..\LIB\pic_mch7.h 

\LIB\res_mch7.h\ 

C:\C700\INCLUDEWmemory.h ..\LIB\projctn7.h 

C:\C700\INCLUDE\math.h 
!IF S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

^C^ C F^G^J)l7FRobj\COR_FNC.sbr COR_FNC.CPP 
<< 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) „ nn 
$(CXXFLAGS_R) /FRobj\COR_FNC.sbr COR_FNC.CPP 
« 

lENDIF 

obi\COR WIN obi : COR.WIN.CPP C:\C700\INCLUDBvmemory.h\ 
CAC700\INCLUDBstdio.h C:\C700\INCLUDBstdlib.h\ 
CAC700\INCLUDE\conio.h C:\C700\INCLUDBmalloc.h\ 
C:\C70O\INCLUDE\floatH C:\C700\INCLUDBgraph.h\ 
C \C700\lNCLUDE\string.h LNS_CORR.h cor_fnc.h ..\LIB\projctn7.h\ 
..\LIB\pic_mch7.h ..\LIB\res_mch7.h c:\ilya\lib\lm_tm7.h\ 
C:\C70O\INCLUDE\math.h 

!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

$(C^^^Dl?Foobj\COR_WIN.objCOR_WlN.CPP 
<< 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

$ C (C>a^^^^^oobj\COR_WIN.obj COR.WIN.CPP 

« 

lENDIF 

obj\COR_WIN.sbr: COR.WIN.CPP C:\C700\INCLUDBvmemory.h\ 
121 

SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



C-\C700MNCLUDEtetdio.hC:\C700\lNCLUDE\stdlib.h\ 
C \C700\ NCLUDEXconio.h C:\C700\lNCLUDE\malloc.h\ 
C \C700\INCLUDBfloat.H C:\C700\INCLUDE\graph.h\ 
C ' \C7 00\ 1 N C LU D E\stri ng . h LNS_CORR.h «J^- BNprt**n7.h\ 
. \LlB\pic_mch7.h ..\LIB\res_mch7.h c:\.lya\l.b\hn_tm7.h\ 
C:\C700\lNCLUDE\math.h . 

!1F$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

« 

?ELSE @$(CXX) @«obj\$(PROJ).rsp 
^2S£S^lF WCOR.WIN.rtr COR.WIN.CPP 
« 

1ENDIF 

obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 
« 

obj\$(PROJ).exe : $(0BJS) ^ _ 

1SSIc^MF^GS,-fS(PR0 J F,LE)0^(P R 0 J ). b5 c 

!IF $(DEBUG) 

$(LRF) @«obj\$(PROJ).lrf 

$(RT OBJS: = 
) $(OBJS: = 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: = +* 
) + 

$(LLIBS_G: = 
) + 

$(LLIBS_D: = 

$(DEF_RLE) $(LFLAGS_G) $(LFLAGS_D); 
« 

!ELSE $(LRF) @«obj\$(PROJ).lrf 
$(RT_0BJS: = + A 
) $(OBJS: = 
) 

$@ 

$(MAPFILE__R) 
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$(L1BS: = + A 

) + 

$(LLIBS_G: = + A 
S(LLIBS_R: = +* 

$(DEF_FILE) S(LFLAGS_G) S(LFLAGS_R); 
« 

IENDIF 

« $(LINKER) @obj\S(PROJ).lrf 



.cpp.obj : 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_D) /Fo$@ $< 
« 

i ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_R) /Fo$@ $< 
« 

IENDIF 

.cpp.sbr: 
!IF$(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
IZs S(CXXFLAGS_G) 
$(CXXFLAGS_D) /FRS@ $< 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) . 
$(CXXFLAGS_R) /FRS@ $< 
« 

IENDIF 



run: obj\$(PROJ).exe 

obj\$(PROJ).exe $(RUNFLAGS) 

debU9 cX P VFKobAS( P ROJ,.exe $,RUNF^GS) 
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// Module calculates correlation functions of PROTO_1 and set of 

prototypes. Set of prototypes' names is defined by a MASK correspondes 
// to names generated by MAKEPRB and has next structure: 
// [path]&RRW_P.rgb 

//Where rj . _ 

// [path] - optional name of directory; 

II & - first letter of file name 

rr _ two digits corresponding to prototype's hight 
„ (RR=16|32|48|64) 

II t w - number corresponding to window number (see 

MAKEPRB 

// description. 
II p prototype Number 

// MASK includes ONLY [path]&RRW_ and gramme Wl11 
// calculate correlation functions for prototypes with P from 0 to 
// first not existing number. 

// COMMAND STRING 

// lns_corr <PROTOJ_Name> <MASK> [CommandFile] 

// <PROTO_1_Name> File name of PROTOTYPE without 

f/* ent <MASK> Mask for prototypes FileNames without extention 

and 

// Prototype's number. 

// [CommandFile] Optional ASCI file with a run time parameters. 
// 

"ll ' NP RGB files of prototypes and corresponding .SGN files created by 
// module MAKEPRB. 
// RUN TIME parameters: 

// 0 0 0 0 -shift for all cases have to be 0 

// <CalorSpace> ^ ^ ^ wo fr e d only with a luminance 

// <Window width> 

// We have used 8 

//SEE ALSO FILE "LNS_CORR.INI" 

// OUT COTelation functions in PROT0J.DBC file. 



#include <stdlib.h> 
#include <conio.h> 
#include <stdio.h> 
#include <string.h> 
#include <graph.h> 
#include <float.H> 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCIYUS94/01679 



#include <io.h> 
#include <time.h> 
#include <ctype.h> 
#indude <iostream.h> 
#include <afx.h> 
#include "LNS_CORR.h" 
#include "cor_win2.h" 
#include "vicalloc.h" 



char f_name[40]=V\FlLE_name[40KJ7 FRAME_Name[40]="_", 

ARGV STO°N<rname[40K_ ,, t SIGN_name[40]="_",TAG_name[9]="_". 
drive[3]= ,, _",dir[30]="_". 

ext[5]="_", *tag_frame; 
double GAMMA=1 .0,CORR_THRESH=0.0,Thresh_mdl=0.0; 

short MAP; 

short VOITlNG=3,TAG_hight; 

struct _videoconfig vc; 

FlLE*datres; 

int FLG_WRIGHT=0; 

double sh[4]={0,0,0,0}; 

PCT pict_target, pict_proto: 
FILE *out_rslt; 

int picture_jnf(char *name,SCR_PNT -vertexes); 

int picture inf num(char *name,SCR_PNT *vertexes shortn); 

int get numbe"r(); // INITIALISATION GRAPH1CMODE, GET SCALE 

int gef number 3(); // INITIALISATION GP^PHICMODE, GET SCALE 

void get_shift_f(FILE ^double - sh); // INITIALISATION GRAPHICMODE, 

vo^g^sh^double-sh); // INITIALISATION GRAPHICMODE, GETSCALE 
irt get_number_3_f(FILE -f); // INITIALISATION GRAPHICMODE. GET 
SCALE 

int pictureJnf.num.Zfchar -name.SCR.PNT •vertexes.short n char -ext); 
^^^^^^^^^^ 

$$$$$$s$sssssss$$s 

short PRESENT_HIGHT=32, CALC_HIGHT =32; 

FILE " INP_PROTOCOL; 
FILE -PROTOCOL; 



CString PROTOCOL_NAME; 
CString PROTOCOL_START; 
CString PROT01 HEADER=CString::CStnng( 
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SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



••PROTO_File\tFRAME_Name\tSTRING_name\tS_name\tSLength\tWinLengt 
h\tSPACE\n M ); 



void init_protocol(char 'name) 

^FLGl^SessCPROTOCOL.NAME.O); 110 if exist 
PR0f"0C0L=fopen(PR0TOCOL_NAME."a"); 

if( f F p L rhif(PROTOCOL;'AUTO and CROSS correlation functions \n %s". 

PROT01_HEADER); 
PROTOCOL_START=name; 
PROTOCOL_START-='V; 

} =-=-================== 

//================== 



int open_inp_prot(char "name) 
{if(!(INP_PROTOCOL=fopen(name, r*))) return 1, 

//split first str 

fscanf(INP_PROTOCOL,;'%*t A \n] s )"■ 
return 0; 
} 



$$$$$$$$$$$$$$$$sss$$ • n . 

//return file name without extwnt.on .n "name and TRUE 1 if file ex.st, 
int next_pict(char -name.char -mask,char *ext int num) 
,nin //if num=-2 initalisation; 

// -1 next 

// >0 adding this # to mask 
// NULL if notexist file with ".rgb" 

{static int now; 
char full_name[80], 
strcpy(name .mask); 
if (num==-2)now=0; 
else if (num==-1 ) 

now++; 
else if (num<0) return 1 ; 
elsenow=num; 

_itoa( now, name+strlen(name), 10); 
strcat(strcpy(full_name,name),ext); 

//1 if file exist 
retum(!_access( full_name, 0 )); 
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#include <fstream.h> 
int ReadStrlnf(char *name,short *StD) 
{ifstream InpF; 
char a[80]; 

strcat(strcpy(a,name),".str"); 
short i; 

lnpF.open(a,ios::in|ios::nocreate); 
if(lnpF.faiI()) 
{InpF.dear(O); 
return 1 ; 

InpF.getlinefa.SO.'Nn'); 
lnpF.getline(a,80,'\n'); 
lnpF.getline(a,80,'\n'); 
InpF.getlineCa.SO.'VY); 
InpF.getlineia.BO.VT); 
InpF.getlineia.SO.'Nn'); 
i=0; 
do 
{ 

inpF»StD[i++]; 
if (lnpF.eof()|| i>17) 

{StD[-i]=-1; 

break; 

} 

lnpF»StD[i++]; 
} 

while(1); 
lnpF.close(); 
return 0; 

} 



SCR_PNT winsize; 

//==================== =—=—=- 

int main(int argc.char* argvQ) 

{int FLG_F=0, FLG_WRIGHT=0; 

FILE "datainf; 

short winstep, map_stnd; 

short n=0; 

SCR_PNT t_pos; 

rf((argc != 3) && (argc !=4)) 

printf(" target-file proto_file_mask \n"); 
FLG_F=0; 
retum(1); 

} 
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else 
if(argc ==4) 
{FLG_F=1; 

jf(!(datainf=fopen(argv[3],"r"))) return 0; 
} 

^Tge^h'ft f(datainf,sh); // GET SCALE 
geCnumber_3_f(datainf); // GET SCALE 
} 

else 

{get_shift(sh); // GET SCALE 0 
get_number_3(); 
} 

strcpy(ARGV_1 , argv[1 ]); 
PROTOCOL_NAME=argv[1]; 
PROTOCOL_NAME+=".dbc"; 
init_protocol(argv[1]); 

// =============== GRAPHICS START 

if(GRAPHlCS_START(&vc,GRAPHMODE)) exit(-1 ); 
//—======= TARGET PICTURE name and vertexes 

SCR_PNT target_pos; // CONSTRACTOR default 0,0 
shorfstrDescr[17]; 
_splitpath( argv[1], drive,dir,TAG_name I ext ); 
pict_target=sign_storage_rgb(argv[1],vc ); 

^ not exist"); GRAPH_OUT(-1);retum -1; 

}; 

winsize.r=pict_target.s_rows; 
^ntf^^ 

-)PROTOCOL S START,FRAME_Narne,STR1NG - n o a r ^ e ;|] GN - name - 
~ pict_target.s_cols,winsize.c,SP[MAP], 
(const char") P ROTO_TAG_H EAD ER); 

//=-======= PROTOTYPE LOOP OVER names 

char proto_name[NAME_LENGTH],buff[4]; 
SCR PNT proto_pos ; z; 

Surname without extention in "name" and TRUE 1 if file exi* 
short proto number=0; //# 0; h- r N 
Se( nexfpict( proto_name,argv[2],".rgb", proto_number)) 
{ proto_number=-1; //next; 
SCR_PNT pr_v[4]; 
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// PROTO INFORMATION IN PROTOCOL 

pict_proto=sign_storage_rgb(proto_name,vc ); 

picturejnf num_2(proto_name,pr_v,0, ,, .str"); //only for SIGN_name 
// 'TAG File\tFRAME_Name\tSTRING_name\tS_Name\tLegnth\n") 
fprintf(PROTOCOL," % 1 2s\t %8s\t %6s\t % 1 2s\t%4d\n", 

proto_name 1 FRAME_Name,STRING_name,SIGN_name,pict_proto.s_cols); 

TAG_hight=pict_proto.s_rows; 
//TARGET PRESENTATION 

_clearscreen(_GCLEARSCREEN); 

proto_pos.c=target_pos.c=1 0; 

proto_pos.r=(target_pos.r=10)+pict_target.s_rows+5; 

sign_present_RGB( pict_target,target_pos); 

sign_present_RGB(pict_proto,proto_pos); 
//================================== 

corr win _proto(pict_target, pict_proto, 

winsi2s,winstep,C0RR_THRESH,StrDescr); 

pict_proto.free_PCT(); 

_displaycursor( _GCURSORON ); 

_setvideomode( _DEFAULTMODE ); 

pict_target.free_PCT(); 

fclose(PROTOCOL); 

retum(O); 

} 



// 



void get_shift_f(FlLE ^double * sh) // INITIALISATION GRAPHICMODE, 
GET SCALE 
{int i; 

for(i=0;i<4; i++) 

fecanf(f ,"%lf %If\rV\sh+i++,sh+i); 
} 

} 

// 



void get_shift(double • sh) // INITIALISATION GRAPHICMODE, GET SCALE 

{ ' nt '' cout« "vertexes shift over rows ( top.right, bottom_right, bottomjeft 
top left %\n"; 

for (i=0;i<4; i++) 
cin»sh[i]; 

} 
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i"nt get_number_3() // INITIALISATION GRAPHICMODE, GET SCALE 
{int R; 

displaycursor( _GCURSORON ); 
"setvideomodef DEFAULTMODE ); 

cout « " [<0 EXIT]. color_map (0-NTSC, 1-HSI,2-NEW,3-RGB,4- 
LUMIN_THR 5-HSI\n"; 
cout«"WIN_SIZE\n "; 
cin »MAP»winsize.c; 
_displaycursor( _GCURSOROFF ); 
_setvideomode( GRAPHMODE ); 
make_palette(); 
return R; 
} _____ 

!nt"get_number_3_f(FILE -0 // INITIALISATION GRAPHICMODE, GET 
SCALE 

{int R; . vx 

fscanf(f," %d %d ",&MAP, &(wmsize.c)); 

return 1; 

} 



int picture_inf(char *name,SCR_PNT "vertexes) 
{int i; 

char new_name[25]; 
FILE*datfp; 

strcat(strcpy(new_nameiname),".sgn"); 
if(!(datfp=fopen(new_name I ,, r ,, ))) return 0; 
fscanf(datfp,"%s\n",new_name); 

for(i=0;i<4;i++) „ „ 

fscanf(datfp,"%d%d\n ,, 1 &(vertexes[i].c),&(vertexes[il.r)); 

fclose(datfp); 
return 1 ; 

> 

//========================== 



int picture_inLnum_2(char *name,SCR_PNT -vertexes.short n.char 
•ext=".sgn") 
{int i j; 

char new_name[45]; 
FILE *datfp; 

strcat(strcpy(new_name,name),ext); 
jf(i(datfp=fopen(new_name, M r"))) return 0; 

/ K &STRING_name, &SIGN_name); 

fora.=0;j<n+1;j++) 
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for(i=0"i<4'i ++ ) 

if(fscanf(datfp. ,, %d%d\n",&(vertexes[i].c) 1 &(vertexes[i].r))==EOF) - 
{fclose (datfp); return 0;} 
fclose(datfp); 
return 1; 

} ==================== ============================ 

/•void write_sign_inf(char "pr.PCT pict_now) 
{ char fl_fp[50],f_name[9]; 

int FLG; 

FILE *dathere,*database; 
_splitpath( pr, drive, dir,f_name,ext ); 
strcat(strcpy(fl_fp,pr),".sgn"); 
dathere=fopen(fl_fp.'V); 

FLG=_access("PROTODB.1", 0 if not exist 

iffKdatabase^openrPROTODB.r'/'a'"))) 

{strcpy(fl_fp,"CAN NOT CREATE D_BASE FILE"); 

fprintfCdathere!" WIN_name FILE_name FRAME.Name STRING_name 
SIGN name\n "); 

fprintf("dathere,"%8s %9s %1Qs %11s %9s \n",f_name, FlLE_name, 
FRAME_Name,STRING_name,SIGN_name); 

' f( ^rintf(database, " W!N_name FILE_name FRAME_Name STRING_name 
SIGN name\n "); 

fprintf(database."%8s %9s %10s %11s %9s \n M ,f_name, FILE_name, 

FRAME_Name,STRING_name,SIGN_name); 
fprintf(dathere,"%d 0\n",pict_now.s_cols-1); 
fprintf(dathere,"%d %d \n",pict_now.s_cols-1 ,pict_now.s_rows-1 ); 
fprintf(dathere," 0 %d\n",pict_now.s_rows-1 ); 
fprintf(dathere," 0 0\n"); 

fclose(dathere); 
fclose(database); 

}*/ = _ = _ = - 

//=========================== 



int picturejnf_nu"m(char *name,SCR_PNT -vertexes, short n) 
{int i.j; " • ' 
char new_name[25j; 
FILE *datfp; 

strca^strcpyCnew^ame.name),' .sgn ); 
if(!(datfp=fopen(new_name, M r"))) return 0; 
fscanf(datfp,"%s\n".new_name); 



m i 
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forU=0;j<n+1;j++) 
fo ^f^ f (^ i «%d%d\n",&(vertexesIi].c).&(vertexes[i].r))==EOF) 
{fclose (datfp); return O;} 
fclose(datfp); 
return 1; 
} 



in7picturejnf_n"um_new(char -name.SCR.PNT -vertexes, short n) 
{int i.j; 

char new_str[80]; 
FILE *datfp; 
int r,FLG=0; 

strcat(strcpy(new_str,name),".sgn ); 
if(!(datfp=fopen(new_str 1 ,, r"))) return 0; 
r=fscanf(datfp,"%[ A \n]s ",new_str); 
r=fscanf(datfp," %[ A \n]s ",new_str); 
if(_iscsymf( (int)new_str[0]))//FILE INFORMATION ) 
//(letter or underscore) 
{ s S canf(new_str,» %s %s %s %s '\&FlLE_name^FRAME_Narne, 
v &STRlNG_name, &SIGN_name), 

r=f scanf (datfp," %[ A \n]s ", new_str); 
} 

forG=0;j<n+1 ;j++) 
for(i=0;i<4;i++) 

if(fscanf(datfp,"%[ A \n]s",new_str)==EOF) 
{fclose (datfp); return 0;} 

ssSnf(new_str," %d %d".&(vertexes[i].c),&(vertexes[i].r)); 

} 

fclose(datfp); 
return 1; 
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#include <vmemory.h> 
#include <stdio.h> 
#include <stdlib.h> 
#include <conio.h> 
#include <malloc.h> 
#include <float.h> 
#include <graph.h> 
#include <string.h> 

#include "lns_corr.h" 
//#include "tem_plt7.h" 
#include "cor_fnc.h" 
//#include "deb_out.h" 

#define MAX_LINE 1024 

extern FILE "PROTOCOL; 

extern double GAMMA,Thresh_mdl; 
extern short MAP; 
extern short VOITING; 
extern struct _videocanfig vc; 

extern charf_name[40],FILE_name[40l, FRAME_Name[40], 

STRlNG_name[40], SIGN_name[40]^ 

//=============================== = 

void draw_int(shortst,shortw,COLOR_VECjntr); 
;/===================================-===~=-==~ == 

void draw_color_corr_1 (COLOR_VEC corr.short F, 

short CH_HIGHT, 

short CH_BASE,double THRESH, 

short pos_now, short size); 

void draw_chart(double -distjine.short n.double max_value=0. 

short CH_HIGHT= 100, 

short CH_BASE= 480,double THRESH=0, 

short t_pos=60); __ ===-=-- 

//======================= ======= 

#defme HOR_HARM 2 
#define VERT_HARM 4 



inline COLOR.VEC sign_for_col(short d, COLOR_VEC col) 
{ COLOR_VEC out; 
int i; 

for(i=0;i<3;i++) 

out.c[i]= d?col.c[i]:-col.c[i]; 

return out; 

m 
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} 



rCOLOR VEC int value_1 (PCT w.double Thr 

COLOR_VEC rp_funct)(COLOR_RGB p1, double 
Thresh_mdl),AVERAGE_VEC w_av) 
{COLOR_VEC col,sum[9][91,out,d ; 
const COLOR.VEC z={0,0,0}; 

short h_t,v_t,i,x,y,h,v I 

half x=w.s_cols»1,half_y=w.s_rows»1 

quoT_x=w.s_cols»2,quot_y=w.s_rows»2; 

long n; 

for(h=0;h<HOR HARM+1 ;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 

sum[v][h].c[0]=sum[v][h].c[1]=sum[vl[h].c[2]-0.0. 

n=w. s_cols*w. s_rows; 
n*=n; 

for(y=0;y<w.s_rows;y++) 
for(v=0;v<VERT_HARM+1 ;v++) 

v t=y*((v+l)»l); 

v ~ t =(v_t+(v & 0x0001 ? quot_y:0))/half_y; 
v _t&= 0x0001; 
for(x=0;x<w.s_co1s;x++) 
{coi=p_funct(w.getj3ixel(y,x).Thr); 

d= sign_for_col(v_t,col); 

for(h=0;h<HOR_HARM+1 ;h++) 

{ h t=x*((h+1)»1); 

h ~t=(h_t+(h & 0x0001 ?quot_x:0))/ha!fjq 
h_t &="bx0001; 
d= sign_for_col(h_t,c1); 
for(i=0;i<3;i++) 
sum[vllh].c[i]+=c1.cp3; 

} 

} 

double s0,dd,max_v=0,th; 
for(dd=i=0;i<3;i++) 

(for(s0=h=0;h<H0R_HARM+1 ;h++) 
for(v=0;v<VERT_HARM+1 ;v++) 

l sO+=sum[v][h].c[i]*sum[v][h].c[i]; 

s0/=n; .... 
dd=w_av.var[i]+w_av.md[i]*w_av.md[il; 

out.c[i]=(dd?s0/dd:1); 
max^v=(max_v<out.c[i])?out.c[.]:max„v; 

} 
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for(i=0;i<3;i++) 
{th=out.c[i]/max_v; 
// THRESHOLDING 
if(th<0.2) 
out.c[i]=0; 

} 

return out; 

}*/ 

//========================= = 

COLOR_VEC (*PointColFunct())(COLOR_RGB p1, double Thresh_mdl) 

{ switch ( MAP) 

{case NTSC:retum(color_space_NTSC); 
case New_plan:return(color_space_NEW); 
case HSI:retum(color_space_RGB); 
case RGB:retum(color_space_RGB_simple); 
case LUMIN_THR:retum(color_space_LUMIN_THR); 
case IHS:retum(color_space_IHS); 

}; 

return NULL; 

} f ====== _ = _ == __ = _ ============= == == ================ 



const short CH_HIGHT_D=1 00, CH_BASE_D=470, 

CH_HIGHT=100, CH_BASE=450, t_pos=40; ^ 

//==============================================-==-=— = 

double scale_fact=1; 

void corr win_proto(PCT win_source,PCT Proto, SCR_PNT win_size 

.short win_step,double C0RR_THRESH, short -StripEnds) 

{ 

short i; 

char mess[40]; 

short F=0; _ ^ J1V 

COLOR_VEC (-p_funct)(COLOR_RGB p1 .double Thresh_mdl); 
p_funct=PointColFunct(); 

PCT win(win_size.c,win_size.r); 

PCT tag(win_size.c.win_size.r); 
SCR_PNT st_t,st_win; 
AVE RAG E_V E C middle_win[64],middle_tag; 
const AVERAGE_VEC z={{0.0,0}. {0.0.0}}; 

COLOR_VEC *corr now.cr. 
const COLOR_VEC z_col={0.0,0.0.0.0}; 
int line_size=win_source.s_cols+Proto.s_cols; 
//memory allocation 



SUBSTITUTE SHEET (RULE 26) 



PCT/US94/01679 



•rf((corr now= (COLOR.VEC*) ma!loc( 
sizeof(COLOR_VEC)*(size_t)line_s.ze*3))==NULL) 
{printf("WIN NOT MEMORY"); return;}; 



st_t.r=0; 
double dd; 

st_win.r=0; 
short k,FLG_COL=1; 
short StripStart,StripStop; 
short PartNum; 
k=PartNum=0 



while(StripEnds[PartNum]>=0) 
{StripStart=StripEnds[PartNum++]; 
StripStop=StripEnds[PartNum++]; 



StripStop=StripEnds[PartNum++]; 

for (st_win.c=StripStart; 
st_win.c+win_size.c<=StripStop;st_win.c+=win_step,k++) 

{ 

FLG_COL=1; 
for(i=0;i<line_size;corr_now[i++]=z_coi); 

win.load_template(win_source,st_win); 
middle_win[k]=average(win t Thresh_mdl,p_funct); 

#ifdef MICI 
#endif 

const COLOR_VEC z_UNIT={1. 0,1. 0,1.0}; 

for (st_t. c=0; st_t c<=Proto. s_cols-win_size.c; st_tc++) 



{ 

II 



tag. load_template(Proto,st_t); 
middle_tag=average(tag t Thresh_mdl,p_funct); 

// DIFF ABS VALUES 

strcpy(mess," VECTOR Approach to CORRELAT ON ) 
LrLnow[sUx]=CoiTelation_single_1(cr,middleJag,m.ddlejvinM 

UNIT); 

^ ^fcc^mess." DIFF ABS VALUES/ max ABS VALUES"); 

Cr= tempiate_abs_diff_1 (tag 1 win,Thresh_mdl,z_UNIT 1 p_funcL 
middle_tag,middle_win[k]); 

#el8e cr=template conv_1( tag,win,Thresh_mdl,z_UNIT,p_funct); 

strcpy(mess? PEARSON CORR. "); . llMm . 

corrj now[sU.c]=Correlation(cr 1 middleJag I middle_w.n[k],z_UNrT), 

#endif 
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#endif 

// ONLY LUMINANCE 

// strcat(mess," ALL 3 COMP"); 

strcaUmess," Only 0 COMP"); 

corr now[st_t.c].cI1 ]=corr_now[st_Lc].c[2]= 
corr_now[st_t.c].c[0]; 

#ifdef MIC I 

^Tn^r^rF 1 L ( GCOL.CH_H,GHT_D.CH.BAS E .D.CORR_THRESH, 
st_t.c,Proto.s_cols); 

FLG_COL=0; 
#endif 

} 

//=====FILL PROTOCOL 

//$ WILL BE USED AS SEPARATOR FOR READING 

fprintf(PROTOC0U"$\t%s\t$\t%4d\t $\n",mess, st_win.c); 

for(i=0;i<Proto.s_cols;i++) //ONLY 0 COMP 

fprintf(PR0TOCOL,"%6g\t",corr_now[i].c[0]); 

fprintf(PROTOCOL," \n"); 

} 

} 

win.free_PCT(); 
tag.free_PCT(); 
free((void *)corr_now); 
return ; 

} ============= 

//======================-= 



^oid drawIch"art(double *distJine,short n.double maxvalue, 

short CH.HIGHT, 

short CH_BASE,double THRESH, 

short t_pos) 

{short i,j; 
double p, 
crit=max_value; 
if(!max_value) 
for (i=0;i<n;i++) 

crit=(distjine[i]>crit)? distjme[i]:cnt; 
else crit=max_value; 
if(!crit) 
crit=1; 

p= CH HlGHT*(1-THRESH/crit); 
_move"o( 0,CH_BASE-CH_HIGHT ); 

m 
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Jineto(n.CH_BASE-CHHIGHT): 
_moveto(0,CH_BASE-<short)p); 

lineto(n,CH_BASE-(short)p); 
_moveto( (short) O.(short) CH_BASE ); 
for (i=0 i< min(n,vc.numxpixels);i++) 
{j=CHlBASE-CH_H!GHT+(short)(distJine[i]XH_HIGHT/crit); 

ifO<0) 
// getch() 

else 

if(!_lineto( i,j)) 
// getch() 

} 

if(t_pos) 

_settextposition( t_pos,30); 
char buffer[30]; 

sprintf(buffer, "MAX = %f10 ", crit ); 
_outtext( buffer ); 



} _ =-=-=-=-=-===: 

//=============================-= 

void draw_int(short st,short w,COLOR_VEC intr) 
{short CH_HIGHT=100, 
CH_BASE=20O; 
double p; 

_setcolor(colonnum(240,240,240)); 
setcolor( color_num(240,0,0)); 
~p=CH_BASE-CH_H IGHT*intr.c[0]; 
_moveto( st,(short)p); 
Jineto(st+w,(short)p); 

_setcolor( color_num(0,240,0)); 
p=CH_BASE-CH_HIGHT"intr.c[1 ]; 
_moveto( st,(short)p); 
_lineto(st+w,(short)p); 

_setcolor( color_num(0,0,240)); 
p=CH_BASE-CH_HIGHT*intr.c[2]; 
_moveto( st,(short)p); 
lineto(st+w,(short)p); 

} _ _ ===-=-===== 

y/==========================~=~ 

Z^Tra^^Z^^O^-.^ 0 corr.COLOR.RGB -corr_old,short F, 
short CH_hTgHT, 
short CH_BASE,double THRESH, 
short pos_now) 
{double p; 
short j; 
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if(F) 

{ _setcolor( color_num(240,240,240)); 
p= CH_HIGHT*(1-THRESH); 

moveto( 0,CH_BASE-CH_HIGHT ); 
Jineto(51 2, C H_BAS E-CH_H I GHT); 
_moveto(0,CH_BASE-(short)p); 
Jineto(512,CH_BASE-{short)p); 

^setcolor(color_num(240,240,240)); 
moveto( pos_now,coiT_old->r); 
PCH_BASE-CH - HIGHT+(short)(corr.c[0]*CH_HIGHT); 

_lineto(pos_now+1 
corr_old->r=j; 

moveto( pos_now,corr_old->g); 

setcolor( color_num(240,0,0)); 
j=CH_BASE-CH_HlGHT+(short)(corr.c[irCH_HIGHT); 

_lineto(pos_now+1 ,j); 
corr_old->g=j; 

_moveto( pos_now,corr_old->b); 

setcolor( color_num(0,240,0)); 
j=CH_BASE-CH_HlGHT+(short)(corr.c[2rCH_HIGHT); 

Jineto(pos_now+1 j); 
corr_old->b=j; 

} = . 

//======================== ' 



void draw_color_corr_1 (COLORVEC corr.short F, 
short CH_HtGHT, 
short CH_BASE,double THRESH, 
short pos_now, short size) 
{ 

short j.Kl.i.st; 

static short real_size.pos_old; 
short POS; 

static COLOR_RGB corr_old; 
real_size=size*scale_fact; 
POS=1 0+pos_now*scale_fact; 
_setcolor( co!or_num(240,240,240)); 
if(F) 

setcolor( color num(0,0,0)); 

~rectangle( _GHLLINTERIOR,0,CH_BASE-3*CH_HIGHT- 

(CH HIGHT_D»1), 

V ~ reai.size ,CH_BASE); 

setcolorf color_num(240,240,240)); 
corr_oid.r=k=CH_BASE-2XH_HIGHT-40; 
st=CH_HIGHT/10; 
for(i=0;i<3;i++) 
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_moveto( 10,k-CH_HIGHT); 
_iineto(10,k); 

lineto(10+real_size,k); 
Imoveto(10,k-CH_HIGHT*THRESH); 
Jineto(10+real_size,k-CH_HIGHTTHRESH); 
for(l=0j=1;j<11;j++) 
{l+=st; 
_moveto( 

0==5)?5:(G==1O)?O:7) ■ 
,k-l); 
_lineto(10,k-l); 
} 

k+=(CH_HlGHT+20); 

corr_old.g=corr_old.r+CH_HIGHT+20; 
corr_old.b=corr_old.g+CH_HIGHT+20; 
pos_old=10; 

_setcoior( color_num(240,240,240)); 
k=CH_BASE; 

_moveto( pos_old,corr_old.b); 
j=k-(short)(corr.c[2]*CH_HIGHT); 
_lineto((short)(POS) j); 
corr_old.b=j; 

k-=(CH_HIGHT+20); 
_moveto( pos_old,corr_old.g); 
j=k-(short)(corr.c[1]*CH_HIGHT); 
Jineto((short)(POS)j); 
corr_old.g=j; 

k— (CH_HIGHT+20); 
_moveto( pos_old,corr_old.r); 
j=k-(short)(corr.c[OrCH_HIGHT); 
Jineto((short)(POS) 
corr_old.r=j; 

pos_old=POS; 



aoo 
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void corr win_proto(PCT win_source,PCT Proto. SCR P NT win_size 
.short win_step, double CORR_THRESH, 
short "StripEnds) ; 
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ORIGIN = PWB 
ORlGIN_VER = 2.0 
PROJ = PRT_ANL2 
PROJFILE = PRT_ANL2.MAK 
BUILDDIR = obj 
DEBUG = 1 



BRFLAGS = /o obj\$(PROJ).bsc 
BSCMAKE = bscmake 
SBRPACK =sbrpack 
NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
BROWSE = 1 
CC =cl 

CFLAGS_G = /W2 /BATCH /FR$*.sbr 
CFLAGS_D = /f/Zi/0d 
CFLAGS_R = /f- /Ot /0i /Ol /Oe /Og /Gs 
CXX = cl 

CXXFLAGS G = /AL /W4 /G2 /D_D0S /BATCH /FR$*.sbr 
CXXFLAGS D = /f- /Od /FPI87 /Zi /DMICI /DSINGLE.WIN 
CXXFLAGSlR = /f- /Ot /Ol /Og /Oe lOi /FPi87 /Gs /DMICI /DSINGLE_WIN 
MAPFILE D = NUL 
MAP FILE R = NUL 

LFLAGSjG = /NOI /STACK:32000 /BATCH /ONERRORlNOEXE 

LFLAGS_D = /CO /FAR /PACKC 

LFLAGS_R = /EXE /FAR /PACKC 

LINKER =link 

ILINK = ilink 

LRF = echo > NUL 

ILFLAGS =/a/e 

LL!BS_G = graphics lafcccr 

CVFLAGS =/25/S 

RUNFLAGS = ..\win4\s160_0 corrthr.06 
PACK_SBRS =1 

FILES = PRT ANL2.CPP ..XLIBWICALLOC.CPP ..\LIB\PROJCTN7.CPP\ 

\LIB\PTC_M7.CPP ..\LIB\RES_MCH7.CPP PRT_2MD.CPP 
OBJS = obj\P RT_AN L2. obj objWICALLOC.obj obj\PROJCTN7.obj 
obj\PIC_M7.obj\ 

obj\RES_MCH7.obj obj\PRT_2MD.obj 
SBRS = obj\PRT_ANL2.sbr objWICALLOC.sbr obj\PROJCTN7.sbr 
obj\PIC_M7.sbr\ ~ 

obj\RES_MCH7.sbr obj\PRT_2MD.sbr 



all: obj\S(PROJ).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .ob] .sbr .cpp 
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obi\PRT ANL2.obj : PRTANL2.CPP C:\C700\INCLUDBstdlib.h\ 
c"\C700\INCLUDE\conio.h C:\C700\INCLUDE\stdio.h\ 
C \C700\INCLUDBstring.h C:\C700\INCLUDBgraph.h\ 
C:\C700\INCLUDE\float.H C:\C700\INCLUDE\time.h 

C\C700\INCLUDE\ctype.h\ 

C:\C700\INCLUDE\fstream.h C:\C700\MFC\INCLUDE\afx.h prt_anls.h\ 
P I C_P RO.hC:\C700\INCLU DE\iostre am . h 

C\C700\MFC\INCLUDE\afx.in!\ 

\LIB\projctn7.h ..\LIB\pic_mch7.h ..\LIB\res_mch7.h\ 
c:\ilya\lib\lin_trn7.h C:\C700\INCLUDE\direct.h 

C:\C700\INCLUDE\ios.h\ 

C\C700\INCLUDE\streamb.hC:\C700\INCLUDE\istream.h\ 
C:\C700\INCLUDE\ostream-h C:\C700\INCLUDE\math.h\ 
C:\C700\INCLUDE\vmemory.h 

!!F $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) n 

$(CXXFLAGS_D) /Foobj\P RT_AN L2. obj PRT.ANL2.CPP 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 

Jc $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj-\PRT_ANL2.obj PRT_ANL2.CPP 

•ENDIF 

objXPRT ANL2.sbr: PRT_ANL2.CPP C:\C700\INCLUDBstdlib.h\ 
C T \C700\INCLUDBconio.h C:\C700\INCLUDBstdio.h\ 
C \C700\INCLUDE\string.h C:\C700\INCLUDBgraph.h\ 
C:\C700\INCLUDE\float.H C:\C700\INCLUDE\time.h 

C:\C700\INCLUDE\ctype.h\ ^ ^ _ . 

C:\C700\INCLUDBfstream.h C:\C700\MFC\INCLUDE\afx.h prt_anls.h\ 
PIC_PRO.h C:\C700\INCLUDE\iostream.h 

C:\C700\MFC\INCLUDBafx-inl\ 

\LIB\projctn7.h „\LIB\pic_mch7.h ..\LlB\res_mch7.h\ 
c:\ilya\lib\lin_tm7.h C:\C700\INCLUDE\directh 

C:\C700\lNCLUDE\ios.h\ 

C\C700\INCLUDE\streamb.h C:\C700\INCLUDBistream.h\ 
C:\C700\INCLUDE\ostream.h C:\C700\INCLUDE\math.h\ 
C:\C700\INCLUD EXvmemory . h 

!IF $(DEBUG) 

@S(CXX) @«obj\$(PROJ).rsp 

IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PRT_ANL2.sbr PRT_ANL2.CPP 
!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
72s $(CXXFLAGS_G) 
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$(CXXFLAGS_R) /FRobj\PRT_ANL2.sbr PRT_ANL2.CPP 



obiWICALLOC.obj : .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\vmemory.h\ 
C:\C700\INCLUDE\maIloc.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FoobjWICALLOC.obj .ALIBWICALLOC.CPP 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FoobjWICALLOC.obj .ALIBWICALLOC.CPP 
« 

iENDIF 

objWICALLOC.sbr: .ALIBWICALLOC.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\stdio.h CAC700\INCLUDE\vmemory.h\ 
CAC700\INCLUDE\malloc.h 

!IF$(DEBUG) 

@$(CXX) @«obj\S(PROJ).rsp 

IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

!ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/2s $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobjWICALLOC.sbr .ALIBWICALLOC.CPP 
« 

iENDIF 

obj\PROJCTN7.obj : ..\LIB\PROJCTN7.CPP C:\C700\INCLUDE\graph.h\ 
CAC700\INCLUDBstdlib.h CAC700\INCLUDE\iostream.h 

..\LIB\projctn7.h\ 

CAC700\INCLUDE\ios.h C:\C700\lNCLUDE\streamb.h\ 
CAC700\INCLUDE\istream.h CAC700\INCLUDE\ostream.h\ 
CAC700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) ^ tm „ 

$(CXXFLAGS_D) /Foobj\PROJCTN7.obj ..\L!B\PROJCTN7.CPP 

« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PROJCTN7.obj .ALIB\PROJCTN7.CPP 
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IENDIF 

obj\PROJCTN7.sbr : ..\LIB\PR0JCTN7.CPP C:\C700\INCLUDE\graph.h\ 
C:\C700\INCLUDE\stdlib.h C:\C700\INCLUDE\iostream.h 

..\LlB\projctn7.h\ 

C \C700\INCLUDE\ios.h C:\C700\INCLUDE\streamb.h\ 

C:\C700\INCLUDE\istream.h C:\C700\INCLUDE\ostream.h\ 

C:\C700\INCLUDE\math.h 
!IF$(DEBUG) 

@$(CXX) @«obj\S(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobjAPROJCTN7.sbr ..\LIB\PR0JCTN7.CPP 
<< 

!ELSE 

@$(CXX) @«obj\S(PROJ).rsp 
/Zs $(CXXFLAGS_G) _ 
$(CXXF1_AGS_R) /FRobj\PROJCTN7.sbr ..\LIB\PR0JCTN7.CPP 
<< 

IENDIF 

obj\PIC_M7.obj : ..\LIB\PIC_M7.CPP C:\C700\INCLUDE\stdiib.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDBgraph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\lNCLUDE\io.h C:\C700\INCLUDE\fcntl.h 

C:\C700\INCLUDE\string.h\ 

C \C700\INCLUDE\float.H C:\C700\INCLUDE\malloc.h ..\LIB\phdr.h\ 
..\LIBWicalIoch ..\LIB\pic_mch7.h C:\C700\INCLUDE\vmemory.h\ 
..\LIB\projctn7.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobi\P!C_M7.obj ..\LIB\PIC_M7.CPP 
« 

!ELSE 

@S(CXX) @«objA$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PIC_M7.obj ..\LIB\PIC_M7.CPP 
« 

IENDIF 

obj\PIC M7 sbr : ..\LIB\PIC M7.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\s7dio.h C:\C700\INCLUDE\graph.h 

C:\C700\INCLUDE\math.h\ 

C:\C700\INCLUDE\io.h C:\C700\INCLUDE\fcntl.h 

C-\C700VlNCLUDE\string.h\ 

C"\C700\INCLUDE\float.H C:\C700\INCLUDE\malloch ..\LIB\phdr.h\ 
..\LIB\vicalloch ..\LIB\pic_mch7.h C:\C700\INCLUDE\vmemory.h\ 
..\LIB\projctn7.h 
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!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\PIC_M7.sbr ..\LIB\PIC_M7.CPP 
<< 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
rZs $(CXXFLAGS_G) 

$(CXXF1_AGS_R) /FRobj\P!C_M7.sbr ..\LIB\PIC_M7.CPP 
•ENDIF 

obj\RES_MCH7.obj : ..\LIB\RES_MCH7.CPP C:\C700\INCLUDE\stdlib.h\ 
C:\C700\INCLUDE\vmemory.h ..\LIBVpic_mch7.h ..\LIB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h .ALIB\projctn7.h C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/c $(CXXFLAGS_G) 

$(CXXF1_AGS_D) /Foobj\RES_MCH7.obj ..\LIB\RES_MCH7.CPP 
« 

!ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\RES_MCH7.obj ..\LIB\RES_MCH7.CPP 
« 

IENDIF 

obj\RES_MCH7.sbr : ..\LIB\RES_MCH7.CPP C:\C700\INCLUDE\stdIib.h\ 
C:\C700\INCLUDE\vmemory.h ..\L!B\pic_mch7.h ..\LlB\res_mch7.h\ 
C:\C700\INCLUDE\graph.h ..\LIB\projctn7.h C:\C700\INCLUDE\math.h 

!IF $(DEBUG) 

@$(CXX) @«obj\5(PROJ).rsp 

IZs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\RES_MCH7.sbr .AL!B\RES_MCH7.CPP 
« 

IELSE 

@S(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobjARES_MCH7.sbr ..\LIB\RES_MCH7.CPP 
« 

IENDIF 

obj\PRT_2MD.obj : PRT_2MD.CPP C:\C700\INCLUDE\io.h 

C:\C700\INCLUDBiostream.h\ 

C:\C700\INCLUDE\fstream.h prt_anls.h PIC_PRO.h 

C:\C700\INCLUDE\ios.h\ 

C:\C700\INCLUDE\streamb.h C:\C700\INCLUDE\istream.h\ 
C:\C700\INCLUDE\ostream.h ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
..\LIB\res_mch7.h c:\ilya\iib\lin_tm7.h C:\C700\INCLUDE\stdlib.h\ 
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C-\C700\INCLUDE\direct.h C:\C700\MFC\lNCLUDE\a6ch\ 
C \C700\INCLUDE\math.h C:\C700\INCLUDE\vmemory.h\ 
C : \C700\INCLUDE\graph.h C:\C700\INCLUDE\string.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\time.h\ 
C:\C700\MFC\INCLUDE\afx.inl 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_D) /Foobj\PRT_2MD.obj PRT_2MD.CPP 
« 

IELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 

$(CXXFLAGS_R) /Foobj\PRT_2MD.obj PRT_2MD.CPP 
1ENDIF 

obj\PRT_2MD.sbr : PRT_2MD.CPP C:\C700\INCLUDE\io.h 

C:\C700\INCLUDE\iostream.h\ 

C:\C700\INCLUDE\fstream.h prt_anls.h PIC_PRO.h 

C:\C700\INCLUDBios.h\ 

C:\C700\INCLUDE\streamb.h C:\C700\INCLUDE\istream.h\ 
C-\C700\INCLUDE\ostream.h ..\LIB\projctn7.h ..\LIB\pic_mch7.h\ 
\LIB\res_mch7.h c:\ilya\lib\lin_tm7.h C:\C700\INCLUDE\stdlib.h\ 
C-\C700\lNCLUDE\direct.h C:\C700\MFC\INCLUDE\afx.h\ 
C-\C700\lNCLUDE\math.h C:\C700\INCLUDE\vmemory.h\ 
C-\C700\INCLUDBgraph.h C:\C700\INCLUDBstring.h\ 
C:\C700\INCLUDE\stdio.h C:\C700\INCLUDE\time.h\ 
C:\C700\MFC\INCLUDE\afx.inl 

!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 

/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_D) /FRobj\P RT_2MD.sbr PRT_2MD.CPP 
« 

•ELSE 

• @$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 

$(CXXFLAGS_R) /FRobj\PRT_2MD.sbr PRT_2MD.CPP 
« 

1ENDIF 



obj\$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
S(BRFLAGS) $(SBRS) 



obj\$(PROJ).exe : $(OBJS) 

-S(NMAKEBSC1 ) MAKEFLAGS= 
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-S(NMAKEBSC2) S(NMFLAGS) -f S(PROJFILE) obj\$(PROJ).bsc 
!IF $(DEBUG) 

$(LRF) @«obj\$(PROJ).lrf 
$(RT_OBJS: = +* 
) $(OBJS: = + A 
) 

$@ 

$(MAPFILE_D) 
$(LIBS: = 
> + 

$(LLIBS_G: = + A 
) + 

$(LLIBS_D: = +* 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_D); 
!ELSE 

$(LRF) @«obj\S(PROJ).lrf 
$(RT_OBJS: = +* 
) $(OBJS: = + A 
) 

$@ 

$(MAPFILE_R) 
$(L!BS: =+* 
) + 

$(LLIBS_G: = +* 
) + 

$(LLIBS_R: = +* 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_R); 
« 

1ENDIF 

S(LINKER) @obj\$(PROJ).lrf 



.cpp.obj : 

!IF S(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_D) /Fo$@ $< 
« 

1ELSE 

@S(CXX) @«obj\$(PROJ).rsp 
/c $(CXXFLAGS_G) 
$(CXXFLAGS_R) /Fo$@ $< 
« 

SENDIF 
xpp.sbr: 
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!IF $(DEBUG) 

@$(CXX) @«obj\$(PROJ).rsp 
IZs $(CXXFLAGS_G) 
$(CXXFLAGS_D) /FRS@ $< 
« 

1ELSE 

@$(CXX) @«obj\$(PROJ).rsp 
/Zs $(CXXFLAGS_G) 
$(CXXFUkGS_R) /FRS@ $< 

IENDIF 



run: obj\$(PROJ).exe 

obj\$(PROJ).exe S(RUNFLAGS) 

debug: obj\$(PROJ).exe 

CVS(CVFLAGS) obj\$(PROJ).exe S(RUNFLAGS) 
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#ifndef PIC_PRO 
#define PIC_PRO 
#include <stdlib.h> 
#include <direct.h> 
#include <afx.h> 
#include <pic_mch7.h> 



CString MakeName(char *p ); 
CString MakeName(CString N); 

//======================= 



const SCR_PNT z_0(0,0); 
class PRT:public PCT 

{public: 
//information 

CString PathName; 
CString FRAME_Number; 
CString STRING_name; 
CString SlGN_name; 

short Pos; // Position in the string 
long NumberOfChk,MaxNum; 
double *Charact; 
//models 

PRT::~PRT() 

{this->free_PCT(); 
Pos=0; 

if(MaxNum) 

delete Charact; 
Charact=NULL; 
MaxNum=NumberOfChk=0; 

} 

// 

PRT::PRT() 

{NumberOfChk=MaxNum=s_cols=s_rows=0; 

Charact=NULL;pict=NULL; 
} 



PRT::PRT (short n_cols, short n_rows) 
T(PCT *)this=PCT:: PCT(n_cols,n_rows); 
NumberOfChk=MaxNum=0; 
Charact=NULL; 

} = = _ ========== 

int read_proto_SGN() 

CString new_name(' ',80); 
PathName=MakeName(PathName); 
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new_name=PathName+' , .sgn"; 
char now[80]; 
FILE *datfp; 

if(i(datfp=fopen((const charjnev^name.V))) return 1; 

if(fscanf(datfp,"%TVn]s ")=EOF)goto ERR; 

if(fscanf(datfp,"%s ",now)==EOF)goto ERR; 

if(fscanf(datfp,"%s ",now)==EOF)goto ERR; 

if(fscanf(datfp > "%s",now)==EOF)goto 
ERR;FRAME_Number=now; 

if(fscanf(datfp,"%s ",now)==EOF)goto 
ERR;STRING_name=now; 

if(fscanf(datfp,"%s ",now)==EOF)goto ERR; SIGN_name=now; 

FRAME_Number.MakeUpper(); 

STRIN(Fnarne.MakeUpper(); 

SIGN_name.MakeUpper(); 
. fclose(datfp); 

return 0; 
ERRrfclose (datfp); return 1; 

} 

//================================ 

int proto storage_rgb(char "name, struct _videoconfig vc) 
~{*(PCT -jthis=sign_storage_rgb(name,vc); 

if (!s_cols) return 1; 

PathName=MakeName(name); 

if (read_proto_SGN()) 
{free_PCT(); 

return 1; 

} 

return 0; 
} 

// — 

int read_proto_DBC(FILE *datfp) 

{ 

char now[80]; 

jf(fscanf(datfp,"%s ",now)==EOF)goto 
ERR; PathName=MakeName(now); 

if(fscanf(datfp."%s ",now)==EOF)goto 
ERR; FRAME_Number=now; 

if(fscanf(datfp,"%s ",now)=EOF)goto 
ERR; STRING name=now; 

jf(fscanf(datfp,"%s ",now)==EOF)goto ERR; SIGN_name=now; 

if(fscanf(datfp,"%d ",&(this->s_cois))==EOF)goto ERR; 

FRAME_Number.MakeUpper(); 

STRING_name.MakeUpper(); 

SIGN_name.MakeUpper(); 

return 1 ; 
ERR: return 0; 

} 



3lh 
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//============================= : 

int alloc_Charact_dbl(long Num) 

^if(!(Charact=new double[Num])) return 1; 
MaxNum=Num; NumberOfChk=0; 
return 0; 
} 

//- " 

void free_Charact() 
{delete Charact; 
Charact=NULL; 

} 

// — 

int read_Charact_dbl(FILE "inp.long Num) 
{short i; 
double d; 

if(MaxNum<(NumberOfChk+Num)) return 1; 
for (i=0;i<Num;i++) 

{if(fscanf(inp,"%lf ",&d) ==EOF) return 1; 
if(fabs(d)<1 .Oe-4) d=0; 

Charact[NumberOfChk]=d; 
NumberOfChk++; 
} 

return 0; 
} 



double CorrVaiue(short WNum.short Pnum) 
{return C(Charact+(long)WNum*s_cols+Pnum)); 
} 

//_ 

}; 

//=================================== 

#define UnKnown -1 

//=================================== 

typedef struct 

{ short n; // voiting numbers 

short pos; // position in string 

double value; //value 
} RSLT; 



void HistCollect(short NOfWin.short St.short Fin.PRT &Db); 
RSLT LineEstimation (short TagSize, PRT &Db,short NOfWin, 

short WSize.double Thr); 
int Linelnf(const PRT &P, PRT T, short rw, short Xpos.struct _videoconfig vc); 
double Linlnter( PRT &P,short WNum.short WSize .double Pt); 
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void HistThresh(short *H,short *BotThr,short TopThr.short num); 
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#ifndef DECISION 

#define DECISION 

#include <iostrearn.h> 

#include ,, PIC_PRO.h" 

#defme UnKnown -1 

//=======================--= 

typedef staict 

{ short n; // voiting numbers 
short pos; // position in string 
double value; //value 

} RSLT; 



void HistThresh(short "H.short *BotThr,short TopThr.short num) 

void HistCollect (short "His, short NOfWin, PRT &Db); 
RSLT LineEstimation (short TagSize, PRT Db, short NOfWin, 

short WSize, double Thr); 
int Writei_inelnf(PRT &P, PRT T, short rw, short Xpos); 
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#ifndef LNS_CORR 
#define LNS_CORR 
#include "prajctn7.h" 
#include "pic_mch7.h" 
#include "res_mch7.h" 
#include "iin_trn7.h" 
//#include "tem_plt7.h" 

#define NAME_LENGTH 40 im ^ occ ™, ^ D 

#def.ne GRAPHMODE _VRES256COLOR 

#define HistDim 101 
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// PRT_ANLS 

II Module analyses file PROTO J .dbc (output of LNS_CORR), 
//calculates histogramme functions of PROTO_1 in file PROTO_1 .hs2. 
//Bisides that it asks a possibilites to connect PROTOJI 
//with another sign in one strip. 
// 

// COMMAND STRING 
// 

// prt_anls <PROTO_1_Name> [CommandFileJ 

// <PROTO_1_Name> File name of PROTOTYPE without 
extention 

// [CommandFile] Optional ASCI file with a run time parameters. 
// 

// .DBC, .RGB files of prototypes and corresponding .SGN files created 
by 

// modules LNS_CORR and MAKEPRB. 

// RUN TIME parameters: 

// 

// <CORR_THR> threshold for sign linking 
// We have used 0.6; 

// |f cross correlation axceede the <CORR_THR> the number of 

// string will be asked. Negative number cause not including the 

// connection in list. 

//SEE ALSO FILE "PRT_ANLS. INI" 
// OUTPUT 

// PROTO_1 .HS2 - Histogramme ; 

// LINECOL.PRT - File collects an information about sign linking 
// in accordance with <CORR_THR> and our response. 

// FILE structure: 

//(example file string start after char # that not belongs to file 

//*****0 pos in str— ± - x " ±-'-'->»< >>■■ ' - ±LL ' limu "' 

// #LineCollection 

// #Line # FName #1 FName #2 Pos ... 

// #1 c:\ilya\winps\s160_0 c:\ilya\winps\s160_6 18 

// #1 c:\ilya\winps\s160_0 c:\ilya\winps\s160_15 37 

//EOF 

// Here 1 Line number named through the keyboard 
//....s160_0 - PROTO_1 name; 

//.... s1 60_6 and s1 60_1 5 name of prototypes linked with a PROTO_1 
// in one strip; 

// 1 8 and 37 positions of corresponding prototypes start relative to 

// 0 colomn of PROTO_1 (PROTO_1 STARTS in 0 colomn of PROTO_1) 

#include <stdlib.h> 
#include <conio.h> 
:#include <stdio.h> 

#include <string.h> <3. Me 
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#include <graph.h> 
#include <float.H> 
#include <time.h> 
#include <ctype.h> 
#include <fstream.h> 
#include <afx.h> 
#include "prt_anls.h" 
#include "P!C_PRO.h" 

#define MaxNumOfPicks 20 
const short MaxNumOfWin =25; 
#define MaxProtNum 25 

short Hist[MaxNumOfWin][HistDim]; 

char LineColNamefJ ="linecol.prt"; 

char f_name[4O]="_",FILE_name[40]="J'. FRAME_Name[40]= _ , 

STRING_name[40]="J'. SIGN_name[40]=''_"; 
double GAMMA=1.0,CORRJTHRESH=0.0Thresh_mdl=0.0; 

short MAP; 

short VOITING=3,TAG_hight; 
struct _videoconfig vc; 
double sh[4]={0,0,0,0}; 

int get number 4(); // INITIALISATION GRAPHICMODE, GET SCALE 
int gef numberl4_f(FILE "0; // INITIALISATION GRAPHICMODE, GET 
SCALE 

//$$$$s$s$$$$s$$$$s$$$$$$$$$$$$$ss$$$$$$$$$$$$$$$$$$$s$$$$$$$$ 
$$$$$ssss$$$$$$$$s 

CString PROTOCOL_NAME; 
ofstream LineC; 

I j----- ------- OpenLineCollection 

void OpenLineCol(const char*name) 

{ LineC. open(name,ios::out|ios::app|ios::out|ios::nocreate); 

if(LineC.fail()) 
{LineC.clear(O); 

LineC. open(name,ios::out|ios::app|ios::out|ios::noreplace); 

if (LineC .fail ()) 
{LineC.clear(O); 

cout « "CAN NOT OPEN LineCollection"; 
GRAPH_OUT(-1); 

} 

} 

} 

//==========================-= 



SCR_PNT winsize; ^ 
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//======================== 

int main(int argc.char* argvQ) 
{ 

int FI_G_F=0; 
FILE Maiainf; 
short n=0; 
SCR_PNT t_pos; 

if((argc != 2) && (argc !=3)) 

printf(" proto_file\n"); 
FLG_F=0; 
retum(1); 

} 

else 
if(arac ==3) 
{FLG_F=1; 

jf(!(datainf=fopen(argv[2],"r"))) return 0; 

} 

if(FLG_F) 

get_number_4_f(datainf); // GET SCALE 
else 
get_number_4(); 

PRT prototype; 

// =============== GRAPHICS START 

if(GRAPHICS_START(&vc,GRAPHMODE)) GRAPH_OUT(-1 ); 
//================ 

if(prototype.proto_storage_rgb(argv[1],vc)) 

{printfC'SGN TARGET not exist"); GRAPH_OUT(-1); 

// READ .DBC FILE AND STORED Correlation Function 
//========= PROTOTYPE LOOP OVER DBASE .dbc 

PRT DbProto[MaxProtNum]; 
CString DbName=argv[1]; 
DbName+=".dbc"; 

FILE *Db=fopen((const char *)DbName,"r"); 
if(!Db) 

{printf("DBase not exist"); GRAPH_OUT(-1 );} 

// DEBUG Split two rows 
short Wir.Size; 
char AA [128],SPACE[14J; 
fscanf(Db,"%[ A \n]s ", AA); 
fscanf(Db," %[ A \n)s", AA); 

fscanf(Db,"%*s %*s %*s %*s %*s %d %s ",&WinSize,SPACE); 
const' MaxNumberOfWin=30; 

short NumberOfWin=0;//=prototype.s_cols/WinSize; 
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short iDbProto=0; 
fscanf(Db."%[ A \n]s ", AA); 

short . 
while( DbProto[iDbProto].read_proto_DBC(Db) ) 

{ 

if(DbProto[iDbProto].aII 0 c_Charact_dbl(MaxNumberOfWin-DbProtonDbProto] 

' S_C ° IS)) {printfC 1 NOT MEMORY for datat"); GRAPH_OUT(-1 );} 
fscanffDb," %r\n]s ",AA); // DEBUG Split one row 
while(!feof(Db)) 
{ 

NumberOfWin++; ■ , 

rf(DbProto[iDbProto].read Charact_dbl(Db,DbProto[iDbProto).s_cols)) 

{printf(" END of DB"); GRAPH_OUT(-1 );} 
Tscanfpb," %[ A \n]s ",AA); // DEBUG Split one row 

} 

iDbProto++; 
> 

fclose(Db); _ 

II END READ .DBC FILE AND STORED Correlation Function 

OpenLineCol(LineColName); ' . 

LineC« "LineCollection \nLine #\t FName #1\t FName #2\t Pos ... \n ; 
//LOOP over targets 
int LN.p; 
RSLT LineEst; 
short St,Fin; 

for (i=0,i<MaxNumOfWin;i++) 
for (j=0;j<HistDim;Hist[i]D++]=O); 

//Miki's Threshold 
short PrNumber=-1 ; 
for(i=0;i<iDbProto;i++) 
if(DbProto[i].PathName==prototype.PathName) 

{PrNumber=i; break;} 
// IF AutoCorr absence PrNumber=-1 

// Line linking and noise calculation 
for (i=0.i<iDbProto;i++) 

{ St=0; 
Fin= DbProto[i].s_cols; 

jf(ji=PrNumber) 

'{LineEst=LineEstimation(prototype.s_cols, DbProto[i],NumberOfWia 
1 WinS ize , CORR_THRE 

SH); 

if (LineEst.n) 

p=LineEst.pos-DbProto[i].s_cols; // DbProtoStart 
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LN=Line!nf(prototype, DbProto[i], vc.numtextrows, p+10,vc); 
if (LN>=0) 
{if (P>0) 
St=prototype.s_cols-p; 

else 
Fin=-p; 

LineC«LN«'\t'«prototype.PathName« "\t « 
DbProto[i].PathName« , \t , «p« , \n , ; 

} 

} 

//Histogramm calculation 
HistCollect(NumberOfWin,St 1 Rn,DbProto[i]); 

} 

LineC.closeO; 
// RESULT OUT 

PROTOCOL_NAME=argv[1 ]; 
PROT0COL_NAME+=".hs2" ; 
OpenLineCol((const char*)PROTOCOL_NAME); 
LineC«"Histogrammes\n"; 

LineC«argv[1 ]«"\t"«prototype.SIGN_name«'\n'; 
LineC«"NumberOfWindows\t"«NumberOfWin«'\n'; 
LineC«"NumberOfBins\t"«HistDim« , \n'; 
LineC«"Win_pos\n"; 

for0=0j<NumberOfWin;j++) 
{LineC«j"WinSize«" \t"; 
for(i=0;i<HistDim;i++) 
LineC«HistO][i]«" \t"; 
LineC«'\n'; 
} 

LineC. close; 

//CORRELATION PROCESSING 

GRAPHJDUTO; 

retum(O): 

} 

// 



/•void get_shift_f(FILE f .double * sh) // INITIALISATION GRAPHICMODE, 
GET SCALE 
{int i; 

for(i=0;i<4; i++) 

{ fscanf(f."%lf %lf\n",sh+i++,sh+i); 
> 
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; o id = ge7shift(double • sh) // INITIALISATION GRAPHICMODE, GET SCALE 

{ ' nt cout<:< "vertexes shift over rows ( top_right, bottom.right, bottomjeft, 
topjeft %\n"; 
t for (i=0;i<4; 

cin»sh[i]; 

} / l / __ === _- = _ ====== ======================================= 

Tnt glrn'Jmbe^C) // INITIALISATION GRAPHICMODE, GET SCALE 
{int R; 

GRAPH_OUT(); 

cout « "CORR_THRESH \n"; 

cin »CORR THRESH; 
// =============—= GRAPHICS START 

if(GRAPHICS_START(&vc,GRAPHMODE)) GRAPH_OUT(-1 ); 

return R; 

> 

int get number_4_f(FILE f) // INITIALISATION GRAPHICMODE, GET 
SCALE 

{ fscanf(f." %lf ",&CORR_THRESH); 
return 1 ; 

} = __ = __ ===== - ======= =================== 

Tint picture_inf_num_new(char *name,SCR_PNT -vertexes .short n) 
{int i j; 

char new_str[80]; 

FILE'datfp; 

intr,FLG=0; 

strcat(strcpy(new_st^ 1 name),".sgn ,, ); 
rf(!(datfp=fopen(new_str,"r"))) return 0; 
r=fscanf(datfp,"%[ A \n]s ",new_str); 
r=fscanf(datfp," %[ A \n]s ",new_str); 
if(_iscsymf( (int)new_str[0]))//FILE INFORMATION ) 
//(letter or underscore) 

{sscanf(new_str." %s %s %s %s ",&FILE_name, &FRAME_Name, 
&STRING_name, &SIGN_name); 

r=fscanf(datfp," %[*\n]s ",new_str); 

} 

forO=0;j<n+1 ;j++) 
for(i=0;i<4;i++) 
{if(FLG) 

if(fscanf(datfp," %[*\n]s",new_str)==EOF) 
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{fclose (datfp); return 0;} 
FLG=1; 

sscanf(new str," %d %d",&(vertexes[i].c) I &(vertexes[i].r)); 
} 

fclose(datfp); 
return 1; 

)7 

/^============================== 
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#include <io.h> 
#include <iostream.h> 
#include <fstream.h> 
#include "prt_anls.h" 
#include "PIC_PRO.h" 

extern const short MaxHistSize; 
extern const short MaxNumOfWin; 

extern short HistrjHistDim]; 

#def.ne Histogramm(i,xMHisW)][(^ 

void HistCollect( short NOfWin.short St,short Fin.PRT &Db) 
{short 
double val; 

for (i=0;i<NOfWin;i++) 
forO=Stj<Fin;j-»-+) 
{ 

val=Db.CorrValue(ij); 
Histogramm(i,vaI); 

} 

} 

//====================================-= — 

RSLT LineEstimation(short TagSize, PRT &Db,short NOfWin.short 
WSize.double Thr) 
{RSLT out={0,-1 ,0.0}; 

short i,j : EndPosDb=0,k; 

double *DMF=new double[k=Db.s_cols+TagS'tze]; 
for (i=0;i<k;DMF[i++]=0.0); 
double val; 

for (i=0;i<NOfWin;i++) 

for(j=0;j<Db.s_cols;j++) 
{ 

val=Db.CorrValue(i,j); 

if(val>Thr) 

{EndPosDb=i*WSize-j+Db.s_cols; 
DMF[EndPosDb]+=vat; 
out.n++; 
} 

} 

if (out. n) 
for(i=0;i<k;i++) 

if(out.value<DMF[i]) 

{out.value=DMF[i]; 
out.pos=i; 

} 

delete DMF; 333 
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return out; 

} == _ ============ ================================ :===: 

WUn8lnf(const PRT &P, PRT T.short rw.short Xpos.struct.videoconf.g vc) 
{SCR PNTPR(10,10),TG(0,18); 
char mess[80}="LineNum [<0] UnKnown ; 
int out=UnKnown ; 
TG.c=Xpos; 

_settextposition(rw,1 ); 

*((PCT *)&T)= v % 

sign_storage_rgb((const char *)(T.PathName),vc); 
if (T.s_cols) 

<_setcolor( color_num(0,0,0)); 

_rectangle( _GFILLINTERIOR,0,0, 680,60 ); 
sign_present_RGB(P,PR); 
sign_present_RGB(T,TG); 
T.free_PCT(); 

_setcolor( color_num(240,240,240)); 
_outtext (mess); 
cin»out; 
} 

else 

{ sprintf(mess,"%s from %s RGB UNAGCESIBLE 

(const char *)(P.SIGN_name), 

(const char *)(T.STRING_name)); 
_outtext (mess); 
} 

return out; 

} -==============: 

//======================= = " 



double CorVal( PRT SP.short WNum.short y) 
{double v1 ; 

if(y<0) v1=P.CorrVaiue(WNum,0); 
else {if(y>=P.s_cols) v1=P.CorrValue(WNum,P.s_cols-1); 
else v1 =P.CorrValue(WNum,(short)y); 
} 

return v1 ; 

} _ === __ 

//=======================--== 



#def.ne VALUE(X) ((X)<(P.s_cols-WSize))?CorVal(P, WNum, 

(X)):CorVal(P, WNum, (X-1)) _ 

//=========================—= =-==-= 

double~Linlnter( PRT SP.short WNum.short WSize .double Pt) 
{double y1 ,yO,x=WNum*WSize+Pt; 
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short x1,x0; 
xO=(short)x; 
x1=(x0>x)?x0-1:x0+1; 
y1=CorVal(P, WNum, x1); 
yO=CorVal( P, WNum, xO); 
return( y0+(x-x0)*(y1 -y0)/(x1 -xO)); 

} _ ================ 

//================== 

void = Hrsfrhresh(short "H.short *BotThr, short TopThr.short num) 
{short S=0; 

*BotThr=0; 

*TopThr=HistDim-1; 

while((S+=H[(*TopThr)-])<num); 

S=0; 

while((S+=H[(-BotThr)++])<num); 

//========================== ============== 

CString MakeName(CString N) 

short k=(N.Spanlncluding(" \t")).GetLength(); 
char *p,fp[80]; 

p=((char*)(const char *)N)+k; 
CString M=p; 
ifrM.FindDO) 
{if(M.GetAt(0)=='\Y) 
{ M=':'+M; 

M= (char)(_getdrive( )-1+'A')+M; 

} 

else 

M=_fullpath(fp, (const char *)M,80); 

} 

M.MakeLower(); 
return M; 

> ==. 

//=========================== = 

CString MakeName(char "p ) 

{CString M(p); 

return (MakeName(M)); 

} 

//============================-= 
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ORIGIN = PWB 
ORIGIN_VER = 2.1.49 
PROJ = TRACK 
PROJFILE = TRACK.MAK 
DEBUG = 1 

NMAKEBSC1 = set 
NMAKEBSC2 = nmake 
CC =cl 

CFLAGS.G = /AL /W2 /G2 /GA /DMSC /DMFG_ /DWIN /DPAS /DDLL /GEf 
/Zp/BATCH\ 

/FR$*.sbr 
CFLAGS_D = /f-/Od/FPi87/Zi/Gs 
CFLAGS_R = /f- /Os /Og /Oe /FPi87 /Gs 
CXX = cl 

CXXFLAGS_G = /G2 /W2 /GA /GEf /Zp /BATCH /FR$*.sbr 
CXXFLAGS_D =/f/Zi/Od/Gs 
CXXFLAGS_R = /f- /Oe /Og /Os /Gs 
MAPFlLE_D =NUL 
MAPFILE_R = NUL 

LFLAGS_G = /STACK.16000 /BATCH /ONERROR:NOEXE 
LFLAGS_D =/CO/NOF 
LFLAGS_R =/NOF 

LLIBS_G = c:\c700\windev\lib\LIBW.LIB c:\c700\windev\Iib\commdlg.lib\ 

c:\visnplus\lib\win_ai.lib c:\visnplus\lib\mfgmm.lib\ 

c:\visnplus\lib\iffdlLIib 
LINKER = link 
ILINK = ilink 
LRF = echo > NUL 
ILFLAGS =/a/e 
RC =rc-K 

LLIBS_R = /NOD:LLIBC7 LLIBC7W 
LLIBS_D = LLIBCEW/NOD:LLIBC7 
BRFLAGS = /o $(PROJ).bsc 
BSCMAKE =bscmake 
SBRPACK = sbrpack 
BROWSE =1 
PACK_SBRS = 1 
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227 

FILES = BITMAP.C MIN.MAG.C PERSP.C TRACK.C TRACK. DEF 
TRACK.RC LIB.C LINES.C\ 

QRSOLV.C 
DEF_FILE = TRACK.DEF 

OBJS = BITMAP. obj MIN_MAG.obj PERSP.obj TRACKobj LIB.obj 
LINES.obJ\ 

QRSOLV.obj 
RESS = TRACK, res 

SBRS = BITMAP. sbr MlN_MAG.sbr PERSP.sbr TRACKLsbr LIB.sbr 
LINES.sbrt 

QRSOLV.sbr 

all: S(PR0J).exe 

.SUFFIXES: 
.SUFFIXES: 

.SUFFIXES: .obj .sbr .res .c .rc 

BITMAP.obj : BITMAP.C const.h bitmap.h lines.h traclch mirwnag.h lib.h 
!IF$(DEBUG) 

@S(CC) @«$(PROJ).rsp 
/c $(CFI_AGS_G) 

$(CFLAGS_D) /FoBITMAP.obj BITMAP.C 
!ELSE 

@S(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_R) /FoBITMAP.obj BITMAP.C 
« 

IENDIF 

BITMAP. sbr : BITMAP.C const.h bitmap.h lines.h track-h min_mag.h lib.h 
!IF$(DEBUG) 

@S(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_D) /FRBITMAP.sbr BITMAP.C 
« 
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'ELSE 

@S(CC) @«$(PROJ).rsp 
JZs $(CFLAGS_G) 

$(CFLAGS_R) /FRBITMAP.sbr BITMAP.C 
« 

IENDIF 

MIN_MAG.obj : MIN_MAG.C consLh bitmap.h lines.h track-h persp.h 
min_mag.h\ 

lib.h 
!IF$(DEBUG) 

@$(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_D) /FoMIN_MAG.obj M1N_MAG.C 
•ELSE 

@S(CC) @«$(PROJ).rsp 
/c $(CF1_AGS_G) 

$(CFLAGS_R) /FoMIN_MAG.obj MIN_MAG.C 
« 

IENDIF 

MlN_MAG.sbr : MIN_MAG.C const.h bitmap.h lines.h track-h persp.h 
min_mag.h\ 

lib.h 
!IF $(DEBUG) 

@S{CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_D) /FRM IN_MAG.sbr MIN_MAG.C 
« 

!ELSE 

@S(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_R) /F RM I N_MAG. sbr MIN_MAG.C 
« 

IENDIF 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



PERSP.obj : PERSP.C const.h bitmap.h lines.h track.h persp.h min_mag.h 
lib.h 

!IF $(DEBUG) 

@S(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_D) /FoPERSP.obj PERSP.C 
!ELSE 

@S(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_R) /FoPERSP.obj PERSP.C 
« 

IENDIF 

PERSP.sbr : PERSP.C consLh bitmap.h lines.h track.h persp.h min_mag.h 
lib.h 

!IF $(DEBUG) 

@S(CC) @«$(PR0J).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_D) /FRPERSP.sbr PERSP.C 
« 

■ELSE 

@$(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_R) /FRPERSP.sbr PERSP.C 
« 

!ENDIF 

TRACK. obj : TRACK. C consth bitmap.h persp.h lines.h track.h min_mag.h 
lib.h 

!IF $(DEBUG) 

@S(CC) @«$(PR0J).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_D) /FoTRACKobj TRACK C 
•ELSE 

@S(CC) @«$(PR0J).rsp 
/c $(CFLAGS_G) 
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$(CFLAGS_R) /FoTRACK.obj TRACK. C 
« 

1ENDIF 

TRACKLsbr : TRACK. C consLh bitmap.h persp.h lines.h tradch min_mag.h 
Iib.h 

HF $(DEBUG) 

@$(CC) @«$(PROJ).rsp 
IZs $(CFLAGS_G) 

$(CFLAGS_D) /FRTRACK.sbr TRACK. C 
« 

JELSE 

@S(CC) @«$(PROJ).rsp 
IZs $(CFLAGS_G) 

S(CFLAGS_R) /FRTRACJCsbr TRACK C 
« 

!ENDIF 

TRACKres : TRACK.RC track-h frames.dig 

$(RC) $(RCFLAGS1 ) /r /fo TRACK. res TRACK. RC 

LIB.obj : LIB.C const.h bitmap.h persp.h lines.h trackh min_mag.h lib.h 
!IF $(DEBUG) 

@S(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 
$(CFLAGS_D) /FoLIB.obj LIB.C 

'ELSE 

@S(CC) @«$(PR0J).rsp 
/c $(CFLAGS_G) 
$(CFLAGS_R) /FoLIB.obj LIB.C 
<< 

•ENDIF 

LIB.sbr : LIB.C const.h bitmap.h persp.h lines.h track.h min_mag.h lib.h 
!IF $(DEBUG) 

@S(CC) @«$(PROJ).rsp 
IZs $(CFLAGS_G) 
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$(CFLAGS_D) /FRLIB.sbr LIB.C 
« 

!ELSE 

@$(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 
$(CFLAGS_R) /FRLIB.sbr LIB.C 

IENDIF 

LINES. obj : LINES.C const.h bitmap.h persp.h lines.h track.h min_mag.h lib.h 
!1F$(DEBUG) 

@$(CC) @«S(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_D) /FoLINES.obj LINES.C 
« 

IELSE 

@S(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_R) /FoLINES.obj LINES.C 
« 

IENDIF 

LINES. sbr : LINES.C consth bitmap.h persp.h lines.h track.h min_mag.h lib.h 
!IF $(DEBUG) 

@S(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_D) /FRLINES.sbr LINES.C 
.'ELSE 

@S(CC) @«$(PROJ).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_R) /FRLINES.sbr LINES.C 
« 

IENDIF 

QRSOLV.obj : QRSOLV.C qrsolv.h 
!IF$(DEBUG) 

@S(CC) @«S(PROJ).rsp 

23» 
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/c S(CFLAGS_G) 

$(CFLAGS_D) /FoQRSOLV.obj QRSOLV.C 
« 

!ELSE 

@S(CC) @«$(PR0J).rsp 
/c $(CFLAGS_G) 

$(CFLAGS_R) /FoQRSOLV.obj QRSOLV.C 
« 

• ENDIF 

QRSOLV.sbr : QRSOLV.C qrsolv.h 
!IF$(DEBUG) 

@$(CC) @«$(PR0J).rsp 
/Zs $(CFLAGS_G) 

$(CFLAGS_D) /FRQRSOLV.sbr QRSOLV.C 
« 

!ELSE 

@S(CC) @«$(PROJ).rsp 
IZs $(CFLAGS_G) 

$(CFLAGS_R) /FRQRSOLV.sbr QRSOLV.C 
« 

IENDIF 



$(PROJ).bsc : $(SBRS) 

$(BSCMAKE) @« 
$(BRFLAGS) $(SBRS) 
<.<. 

$(PROJ).exe : $(DEF_FILE) $(OBJS) $(RESS) 
-$(NMAKEBSC1) MAKEFLAGS= 

-S(NMAKEBSC2) $(NMFLAGS) -f S(PROJFILE) S(PROJ).bsc 
!IF$(DEBUG) 

S(LRF) @«$(PROJ).lrf 
$(RT_OBJS: = + A 
) $(OBJS: = +* 
) 

$@ 

£2A 
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$(MAPFILE_D) 
$(LIBS: = 
) + 

$(LLIBS_G: = +* 
) + 

$(LLIBS_D: = + A 
) 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_D); 
« 

■ELSE 

$(LRF) @«$(PROJ).lrf 
$(RT_OBJS: = +* 
) $(OBJS: = + A 
) 

$@ 

$(MAPFILE_R) 
$(LIBS: = 
) + 

$(LLIBS_G: = 
) + 

$(LLIBS_R: = + A 
) 

$(DEF_FILE) $(LFLAGS_G) $(LFLAGS_R); 
« 

IEND1F 

S(LINKER) @$(PROJ).lrf 

$(RC) $(RCFLAGS2) $(RESS) $@ 



x.obj : 

!IF S(DEBUG) 

@$(CC) @«$(PROJ).rsp 
/c $(CFLAGS_G) 
$(CFLAGS_D) /Fo$@ S< 
.« 

1ELSE 

@S('CC) @«$(PROJ).rsp 
/c S(CFLAGS_G) 
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$(CFLAGS_R) /Fo$@ $< 
« 

IENDIF 
.c.sbr : 

!IF $(DEBUG) 

@$(CC) @«$(PROJ).rsp 
TZs $(CFLAGS_G) 
$(CFLAGS_D) /FR$@ $< 
« 

!ELSE 

@$(CC) @«$(PROJ).rsp 
TZs $(CFLAGS_G) 
$(CFLAGS_R) /FR$@ $< 
« 

IENDIF 
.rc.res : 

$(RC) $(RCFLAGS1) /r /fo $@ $< 



run: $(PR0J).exe 

WX $(WXFLAGS) $(PROJ).exe S(RUNFLAGS) 

debug: S(PROJ).exe 

WX /p S(WXFLAGS) CVW $(CVFLAGS) $(PROJ).exe $(RUNFLAGS) 



534 
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NAME TRANSFORM 

DESCRIPTION 'Changing signs' 

EXETYPE WINDOWS 

STUB 'WINSTUB.EXE' 

CODE PRELOAD MOVEABLE DISCARDABLE 

DATA PRELOAD MOVEABLE MULTIPLE 

HEAPS1ZE 1024 

STACKSZE 8192 



3&> 
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#include <windows.h> 
#include "track, h" 
#include "frames. dig" 



trans MENU 
{ 

POPUP "File" 
{ 

MENUITEM "Open...", IDM.OPEN 
MENUITEM "Write...", IDMJ/VRITE 
} 



POPUP "&Pick sign" 
{ 

MENUITEM ".SOriginal", 
MENUITEM "aSubstitue", 
MENUITEM "&Load Orig", 
MENUITEM "&Pick Comers", 
} 

MENUITEM "&change sign", 



IDM_PICK_ORIG 
IDM_PICK_SUBST 
IDM_LOAD_ORIG 
lDM_PICK_CORNERS 

IDM.CHANGE 



POPUP "&Method" 
{ 

MENUITEM "^Bilinear", 
MENUITEM "aTrilinear", 
MENUITEM "&SplitMode", 
} 

MENUITEM "ainfo", 

POPUP "&MFG" 
{ 

MENUITEM "&lnit" DISPJNIT 
MENUITEM "aGrab" DISP_GRAB 
. MENUITEM "&Snap" DISP_SNAP 
MENUITEM "&Load Pict" DISP_LOAD 
MENUITEM "&Load Field" DISP_LOAD_FIELD 
MENUITEM "&Draw" DISP_DRAW 

ash 



IDM_BILINEAR 
IDM_TRILINEAR 
IDM_SPLIT 

IDMJNFO 
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MENUITEM "&Clean" D1SP_CLEAN 
MENUITEM "SWipe" DISP_WIPE 

MENUITEM "&Start track", \ D M_START_TRAC K 
MENUITEM "aTracking", IDM_AUTO_TRACK 

POPUP "SV-Disk" 
{ 

MENUITEM "&lnit", SONYJNIT 
MENUITEM "&Go to", SONY_FRAME 
MENUITEM '^Replace", SONY_RECORD 
MENUITEM "fcClose", SONY_END 
> 
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frames DIALOG 19, 22, 126, 57 

STYLE DS.MODALFRAME | WS_POPUP | WS.VISIBLE | WS.CAPTION | 

WS_SYSMENU 

CAPTION "Edit Frames" 

FONT 8, "MS Sans Serif' 

BEGIN 

LTEXT "From Frame", 1 01 , 1 0, 4, 48, 8 
LTEXT 'To Frame", 102, 10, 22, 56. 8 
EDnTEXT 103, 67, 4, 45, 13. ES.AUTOHSCROLL 
EDITTEXT 104. 67, 21, 45, 14, ES_AUTOHSCR0LL 
PUSHBUTTON "OK", 105, 7, 39, 40, 14 
PUSHBUTTON "Cancel". 106. 72, 38. 40. 14 
END 
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long FAR PASCAL .export WndProc (HWND, UINT, UINT, LONG) ; 

DWORD GetDiblnfoHeaderSize (BYTE huge * ) ; 

,nt PASCAL GetDibWidth (BYTE huge * ) ; 

int PASCAL GetDibHeight (BYTE huge • ) ; 

BYTE huge * GetDibBitsAddr (BYTE huge * ) ; 

DWORD GetDrawTableSize(BYTE huge *) ; 

BYTE huge * ReadDib (HWND ,char * .int'.int*) ; 

int PASCAL display_information(HWND ) ; 

int PASCAL teach_grey_pallete(HWND . int ) ; 

BYTE huge * ReadRGB(HWND ,char * .inr.int*) ; 

int PASCAL draw_rgb_picture(HWND ,HDC) ; 

int PASCAL teach_rgb_pallete(HWND) ; 

int PASCAL get_file_type_by_name(char * ) ; 

int PASCAL create _poly_src_dst() ; 

int PASCAL keep_subst(HWND,MYBITMAP*) ; 

BYTE PASCAL get_palette_index(BYTE , BYTE , BYTE ) ; 

int PASCAL WriteGreyRgb (HWND hwnd.char *szFileName,MYBnrMAP 

*Bmap) ; 

int PASCAL get_in_series_flag() ; 

int PASCAL smooth_values(double , double /.double *,int,double *) ; 
int PASCAL enlarge_area_of_noise(MYBITMAP *,MYBITMAP ~) ; 

#define GREY_MODEL 1 
#define COLOR_MODEL 2 
#define RGBA_MODEL 3 

#define IN_BILINEAR 2 
#define IN_TRILINEAR 3 



#define FILE_IS_BMP 1 
#define FILE_IS_RGB 2 
#define FILE_IS_UNKNOWN 3 

#define AF.ZOOM 102 

#define AF_ANGLE 104 

#defineAF_OK 105 

#define AF_CANCEL 105 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



#define PER_WIDTH 103 
#define PER_HEIGHT 104 
#def.ne PER_FR0M_T0P 107 
#defme PER_FROM_BOTTOM 108 
#define PER_OK 109 
#define PER_CANCEL 110 

#define IDM_OPEN 100 
#define !DM_PICK 101 
#define IDM_CHANGE 104 
#define IDM_PERSPECTIVE 102 
#define IDMJNFO 103 
#define 1DM_WRITE 105 
#define IDM_PICK_ORIG 106 
#defme IDM_PICK_SUBST 107 
#define IDM_LOAD_ORIG 108 
#defme IDM_PICK_CORNERS 109 

#define IDM_NEAREST 110 
#define 1DM_BILINEAR 111 
#define 1DM_TRILINEAR 112 
#define IDM_SPLIT 114 

#define IDM_START_TRACK 150 
#define IDM_AUTO_TRACK 151 

#defme DISP_SNAP 200 
#defme DISP_GRAB 201 
#define DISP_L0AD 202 
#define DISP_DRAW 203 
#define DISP_CLEAN 204 
#define DISP_WIPE 205 
#defme DISPJNIT 206 
#define DISP_LOAD_FIELD 207 

#defme IDM_DEBUG 300 
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#define SONY_HEADER 400 
#define S0NY_FRAME 401 
#define S0NY_RECORD 402 
#defme SONYJNIT 403 
#define SONY_END 404 

#define SONY_FROM_FR 103 
#define SONY_TO_FR 104 
#define SONYJDK 105 
#define SONY_CANCEL 106 

typedef struct phdr { 

int cols, rows ; 

int bp ; 
} PHDR ; 

typedef BYTE TRIPLE[3] ; 



typedef struct edge { 

double xs, ys; 

double xe. ye; 

int vertical; 

LINE I; 
} EDGE; 

typedef struct shift { 
double dx, dy, 

double sim; r minimal value of sum of abs. diff. (MAD) 
maximal value of correlation (COR) */ 

} SHIFT; 

typedef struct sign { 

MYBITMAP -Bmap ; 

MYBITMAP •BmapGrey ; 

TRACK_POINTS TrPoints ; 
} SIGN: 
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#include<math.h> 
#include<stdio.h> 

typedef unsigned char byte; 

typedef struct { 
unsigned long 

r: 8, 

g:B, 

t>:8, 

a : 8; 
} RGB A; 

typedef struct { 

double x ; 

double y ; 
} RPOINT ; 

typedef struct { 

byte r, g, b; 
} MYRGB; 

typedef enum { 

Grey, Rgb, Rgba 
} BMTYPE; 

typedef struct { 

int cols, rows; 

BMTYPE typ; 

BYTE huge-gpic; 
} MYBITMAP; 

typedef double LUMARR[7][7] ; 

#defme BITMAP_PLACE(bm,ij) \ 
•((BYTE huge-)((bm->gpic) + (DWORD)(ir(DWORD)(bm- 

>cols)+(DWORD)G))) 

#define B ITM AP_P LAC E_PTR ( bm, i j) \ 
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(BYTEhuge-)((bm->gpic) + (DWORD)(i)*(DWORD)(bm->cols) + (DWORD)G)) 

#define B ITMAP_RG B_P LAC E(bm, i , j) V 

-((BYTEhuge-)((bm->gpicH(DWORD)(i)-(DWORD)(bm- 

>co!s)+(DWORD)0')r(DWORD)3)) 

#def.ne BrrMAP_RGB_PLACE_PTR(bm,i,j) \ 

(BYTE huge*)((bm->gpic) + ((DWORD)(i)*(DWORD)(bm- 
>cols)+(DWORD)0))*(DWORD)3) 

#define MlN(a, b) ((a) < (b) ? (a) : (b)) 
#defme MAX(a, b) ((a) > (b) ? (a) : (b)) 

#defme DLVLS 3 
#defme ILVLS 1 

#define MAX_NO_OF_TR_WIN 30 

typedef struct { 
double x, y; 
} PNT; 

typedef struct { 
' double Af[3][3]; 

double Ab[3][3]; 
} Affine_Transform; 

typedef struct { 

double Pf[3][3]; 

double Pb[3][3]; 
} Perspective_Transform; 

typedef struct track_points { 

POINT TrackP[NUM_OF_TRACK_POINTS] ; 

int NumOfPoints ; 
} TRACK_POINTS ; 

typedef struct shift_points { 

RPOINT TrackP[NUM_OF_TRACK_POINTS] ; 

3*^3 
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int NumOfPoints ; 
} SH!FT_POINTS ; 

typedef staict tr_win { 

RPOINT Center ; 

double Xdir ; 

double Ydir ; 
} TR_WIN ; 

MYBITMAP FAR* bm_alioc(int , int , BMTYPE ) ; 
double PASCAL bilinear(double , double , MYBITMAP FAR ") ; 
double PASCAL bilinear_red(double , double , MYBITMAP FAR *) ; 
double PASCAL bilinear_green(double , double , MYBITMAP FAR *) ; 
double PASCAL bilinear_blue(double , double , MYBITMAP FAR *) ; 
int PASCAL multmat(HWND,int , int , int , double *, double *, double *); 
double PASCAL resample_triIinear(MYBITMAP FAR* 
,double : double,double,int) ; 

double PASCAL resample_trilinear_red(MYBITMAP FAR* 
,double,double,double,int) ; 

double PASCAL resample_triIinear_blue(MYBITMAP FAR* 
,double,double,double,int) ; 

double PASCAL resample_triIinear_green(MYBITMAP FAR* 
.double.double.double.int) ; 

int PASCAL bui!d_pyramid(HWND,MYB!TMAP FAR * ) ; 

int PASCAL bm_free(MYBITMAP FAR* ) ; 

int PASCAL create_lum_bmap(MYB!TMAP *, MYBITMAP **) ; 

int PASCAL duplicate_bmap(MYBITMAP *. MYBITMAP **,int ) ; 

int PASCAL create_grey_bounded_bitmap(RECT, MYBITMAP *, MYBITMAP 

**); 

int PASCAL substract_bitmaps(RECT,MYBITMAP *, MYBITMAP ".MYBITMAP 

**); 

int PASCAL insert_grey_bounded_bitmap(RECT .MYBITMAP *, MYBITMAP 

*) ; 

int PASCAL get_mask_bitmap(HWND,MYBITMAP *,int .MYBITMAP **) ; 
int PASCAL f.nd_horizJine(MYBITMAP*POINT , POINT , RPOINT *) ; 
int PASCAL find_verticJine(MYBlTMAP -.POINT . POINT . RPOINT *) ; 
double PASCAL bilinear_rgb(double. double . MYBITMAP FAR* .double *) ; 
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int PASCAL copy_grey_rect_from_frame(MYBITMAP *, MYBITMAP *,RECT ) 

Snt PASCAL build_a!pha_map(MYBITMAP ~ MYBFTMAP*,RPOINT «) ; 
int PASCAL split_bitmap(MYBITMAP *,int,int ) ; 

int PASCAL split_bitmapJrarne(MYBITMAP *, MYBITMAP ~ MYBITMAP ") ; 

int PASCAL sum_grey_bitmap_value(MYBITMAP *,DWORD *) ; 

int PASCAL filter_noises_by_rects(MYBITMAP *,RECT ,int , int .MYBITMAP 

-); 



SW5 
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#define VALUEJN(array,Lj,cols) -(array +(DWORD)(i)-(DWORD)(cols) +0)) 
#define X_DIM 1 
#define Y_D!M 2 



int PASCAL l_cpJnt_arrJo_RPOINT(RPOINT *, int *, int *,int ); 

int PASCAL !_quad_in_new_origin(RPOINT *,RPOINT Vint ,int ,int ) ; 

int PASCAL find_extremes_in_1dim(RP0INT *. int , int .double *, double *); 

int PASCAL find_best_duster(HWND, int,RPOINT *,RPOINT *,int 

*, int, int*, int*, 

RPOINT*,inr); 

int PASCAL l_copy_RPOINT_array(RPOINT *,RPOINT *,int ) ; 

int PASCAL l_copy_int_array(int *,int *,int ) ; 

int PASCAL l_find_bound_rect(RPOINT *, RECT *) ; 

int PASCAL print_transform(HFILE ,char *,Perspective_Transform *) ; 

int PASCAL insert^nev^vertexesCRPOlNT-CurrVert, RPOINT *Vert1, 

RPOINT *Vert2, 

RPOINT *Vert3, RPOINT *Vert4,double *Wheight,int num.RPOINT 
*NewVert) ; 

int PASCAL transform_rpoint_arr(RPO!NT *,RPOlNT 
* int,Perspective_Transform) ; 
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#define FAC 16 

#define LOBES 2 

#defme FSIZE (LOBES * FAC) 

#define CORR.WINDOWX 8 

#define CORR_WINDOWY 6 

MYBITMAP FAR * minify(HWND, MYBITMAP FAR *, int) ; 
int PASCAL sinc_filter(int) ; 

MYBfTMAP FAR *hmintfy(HWND, MYBUMAP FAR *, int); 

MYBITMAP FAR *vminify(HWND, MYBFTMAP FAR *, int ) ; 

int PASCAL lpf1D(BYTE huge* , int, int, BYTE huge *) ; 

int PASCAL Ipf 1 D_rgb(BYTE huge* , int, int, BYTE huge *) ; 

int PASCAL edge_refme(MYBITMAP *,EDGE *, int) ; 

int PASCAL h_refine(MYBrTMAP *, double *, double *,int) ; 

int PASCAL v_refine(MYBITMAP *. double *, double *,int) ; 

int PASCAL sub_pixel_interp(double, double, double, double *, double *em) ; 

int PASCAL xysolve(HWND,MYBITMAP *,MYBITMAP *,SHIFT *,TR_WIN *, 

int, 

TRACK_POINTS*. 

TRACK_POINTS*,Perspective_Transform*,HFILE, 

TRACK_POINTS*.RPOINT*) ; 
int PASCAL xysrch(HWND,MYBlTMAP *,MYBITMAP *, SHIFT 
*,POINT,POINT, 
int,int,intint); 

int PASCAL sub_pixel_refine(int , int , intint.SHIFT *) ; 
int PASCAL find_average_shift(HWND,int .SHIFT 
*,SHIFT_POINTS,SHIFT_POINTS, 

Perspective_Transform*) ; 

int PASCAL Quad2Quad(HWND .RPOINT srcpnts[4],RPOINT dstpnts[4], 
Perspective_Transform *) ; 

int PASCAL copy_transform(Perspective_Transform *,Perspective_Transform 

int' PASCAL Thin_Perspective(HWND , SHIFT_POINTS , SHIFT_POINTS 
.int. 
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Perspective_Transform *) ; 
PASCAL trans_grey_frame_to_fields(HWND .RPOINT «,RPOINT 
MYBITMAP *,RPOINT *, MYBITMAP **, MYBITMAP ~) ; 
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#define det2(a1 1 , a12, a21 , a22) (a1 1 • a22 - a12 * a21 ) 

int PASCAL perspecti ve( H WN D , MYB ITMAP FAR * MYBITMAP 
FAR*, RPOINT* RP Ol NT*, int, 

Perspective_Transform* ) ; 
int PASCAL Rectan2Quad(HWND,RPOINT *, RPOINT 
~,Perspective_Transform*) ; 

int PASCAL Perspective_map(MYBITMAP FAR*, Perspecti ve_Transform* , 

MYBITMAP FAR*, RPOINT *,int) ; 
RPOINT bPerspective(RPOINT, Perspective_Transform *) ; 
RPOINT PASCAL dPerspective(RPOINT , Perspective_Transform *) ; 
int PASCAL check_if_rect(RPOlNT* ) ; 

RPOINT PASCAL fPerspective(RPOINT , Perspecti ve_Transform *) ; 

int PASCAL median_filter_5(HWND,MYBITMAP *) ; 

int PASCAL get_tresh_for_occ(MYBITMAP *,int *) ; 

int PASCAL perspective_mask(HWND .MYBITMAP ■* MYB ITMAP *, 

MYBITMAP *, 

RPOINT *, RPOINT *, int ,int .MYBITMAP •); 
int PASCAL Perspective_map_mask(MYBITMAP FAR 
*,Perspective_Transform* , 

MYBITMAP FAR *, MYBITMAP *,RPOINT *,int ,int .MYBITMAP *) ; 
int PASCAL Quad2Rectan(HWND , RPOINT RPOINT 
*,Perspective_Transform *); 

int PASCAL perspective_al(HWND .MYBITMAP FAR *,MYB ITMAP FAR 
*, MYB ITMAP *. 

RPOINT* .RPOINT * ,int ,Perspective_Transform *) ; 
int PASCAL Perspective_map_aI(MYBrTMAP *.Perspective_Transform *, 
MYBITMAP *, MYBITMAP *,RPOINT *,int ) ; 

int PASCAL Perspective_near_map(MYB ITMAP *,Perspective_Transfor 
m* , 

MYBITMAP *. RPOINT *,int ) ; 
int PASCAL perspective_near(HWND .MYBITMAP *. MYBITMAP *, 
RPOINT* .RPOINT * ,int ,Perspective_Transform *) ; 
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#include <windows.h> 
#include <windowsx.h> 
#include <commdlg.h> 
#include <stdlib.h> 
#include <bios.h> 
#include "consth" 
#include "bitmap.h" 
#ihclude "persp.h" 
#include "lines.h" 
#include "traclch" 
#include "min_mag.h" 
#inc!ude Tib.h" 
#undef RGB 
#include <mfghost.h> 



#define UNTIL_FRAME 420 
#define UNTIL_PICT 4 

int PASCAL bitmap_for_display(HWND I HDC I MYBITMAP FAR *,RECT) ; 

int PASCAL draw to_screen(MYBITMAP Mnt.int) ; 

int PASCAL create_disp_bmap(MYBITMAP *, MYBITMAP ,RECT) ; 

int PASCAL pick_sign(HWND , UINT , UINT , LONG ) ; 

int PASCAL change_sign(HWND , UINT , UINT LONG ) , 

int PASCAL add_tracking_point(HWND , UINT , UINT , LONG ) , 

int PASCAL change sign_by_tracking(HWND,int) ; 

int PASCAL WriteRgb (HWND ,char *, MYBITMAP *) ; 

i£ PASCAL create^norrn brnap(HWND .MYBITMAP *, M YB ITMAP**, RECT) ; 
int PASCAL keep_orig(HWND .MYBITMAP •) ; 

int PASCAL pick_original(HWND, UINT. UINT, LONG) : ^ opniMT 

int PASCAL creaTe_mask_bmap(HWND .MYBITMAP -.RPOINT -.RPOINT 

infpASC^L B WrU^ (HWND hwnd.char *szFileName, MYBITMAP 

int™ ASCAL add dean_points(HWND, UINT , UINT , LONG ) ; 

BOOL FAR PASCAL export FramesDlg(HWND ,UINT .UINT .LONG ) ; 

UINT FAR PASCAL .export TimerProc(HWND, UINT.UINT.LONG) ; 

int PASCAL SonySearch(HWND,int , int ) ; 

int PASCAL SonyRecord(HWND, int) ; 

int PASCAL load_field_from_card(HWND,int) ; 

int PASCAL load_picture_from_card(HWND) ; 

int PASCAL loadj>icture_from_file(HWND ,char ") ; 

int PASCAL draw f,eld_to_screen(HWND .MYBITMAP ".int ) ; 

int PASCAL WriteSign (HWND ,char *,SIGN •) ; 

int PASCAL ReadSign(HWND .char *.SIGN"); 

int PASCAL pick corners(HWND . UINT . UINT . LONG ) ; onrtIKrr 
int PASCAL get_f.ttness_of_vertexes(HWND.RECT .MYBITMAP -.RPOINT 
•.DWORD*);: 

int PASCAL replace_sign(HWND. RPOINT *) ; 
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int PASCAL create_subs_sign(HWND hwnd) ; 
int PASCAL fill_mask_rect(MYBITMAP w ) ; 
int PASCAL ValidateOccRects(MYBITMAP *) ; 
int PASCAL copy_into_valid_rects() ; 

char szAppName [] = 'Trans" ; 
static BYTE huge * IpRgb ; 
static BYTE huge * IpGreyRgb ; 
static BYTE huge * IpPtr; 
static BYTE huge * IpRepaint ; 
static BYTE huge * IpDisplay ; 
static BYTE huge * ipBits ; 
PALETTEENTRY FAR -ppalentr ; 
PALETTEENTRY FAR ppalsys[256] ; 
BYTE FAR ColorTable[32][32][32] ; 
H PALETTE glhpal. hpalprev ; 
LOGPALETTE Igcpal ; 
RECT GIBound ; 

WORD gIModel Color = COLOR_MODEL ; 

char stBufferZoom[50] ; 

char stBufferAngle[50] ; 

char stBufferWidth[50] ; 

int OrgX[8],OrgY[8] ; 

int SignX[4],SignY[4] ; 

char stBufferHeight[50] ; 

char stBufferFrTop[50] ; 

char stBufferFrBot[50] ; 

RPOINT SrcPoly[4], DstPoly[4], KeepPoly[4] ; 

RPOINT BstDst[4] ; 

int InterpMode = IN_BILINEAR ; 

MYBITMAP FAR *SrcBmap=NULL ; 

MYBITMAP FAR *SrcLumap=NULL ; 

MYBITMAP FAR *SubstBmap=NULL ; 

MYBITMAP FAR *Subs=NULL ; 

MYBITMAP FAR *Dispmap=NULL ; 

MYBITMAP FAR "Normap=NULL ; 

MYBITMAP FAR "MskBmap=NULL ; 

SIGN OriginSign ; 

RECT ClientRect ; 

int IsRgb ; 

int FileType ; 

int SubstCols.SubstRows ; 

int OrigCols.OrigRows ; 

int CurrP, UnderPicking.UnderChanging.UnderTracking, 

UnderOrig.UnderCorners ; 
int InClean ; 
BYTE huge* IpSubst ; 
BYTE rpixarr[758] ; 

TRACK_POINTS TrackBase, TrackCurr ; 

SGI 
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Perspective_Transform BasicTransf; 
Perspective_Transform ShiftTransf; 
int CleanX[2] ; 
int CleanY[2] ; 
int CleanCount ; 

static FARPROC IpfnTimeProc ; 
static LONG RecFrame = 20908; 
static int SearchFrame = 15662 ; 
int TimeElapsed ; 



static int PortNumber ; 

int FromFr, 

static int ToFr = UNTIL_PICT ; 

int PictCount = 0 ; 

int IsOddLine = 0 ; 



static DWORD Ticks; 

int Waslnit = 0; 

int SplitMode = 0 ; 

OFSTRUCT of ; 

HFILE hFile ; 

int NumberOfField = 0 ; 

double Vert1[4], Vert2[4], Vert3[4], Vert4[4] ; 

double VertWeightrj = {2.0,2.0,3.0,3.0} ; 

static int InSerieMode = 0 ; 

static int ReplaceFlag = 1 ; 

int DummyFrames = 0 ; 

#define DYMMIES 0 

RECT ValidOccRects[5] ; 

int NumOfValidOccRects ; 

RECT OcclusionRects[5] ; 

int NumOfOccRects ; 

int PASCAL WinMain (HANDLE hlnstance, HANDLE hPrevlnstance, 
LPSTR IpszCmdLine, int nCmdShow) 

{ 

HWND hwnd ; 

MSG msg ; 
WNDCLASS wndclass ; 

if (! hPrevlnstance) 

wndclass.style = CS_HREDRAW | CS_VREDRAW ; 

wndciass.lpfnWndProc = WndProc ; 

wndclass. cbClsExtra = 0 ; 

wndclass. cbWndExtra = 0 ; 

wndclass.hlnstance = hlnstance ; 

wndclass. hlcon = NULL ; 

wndclass.hCursor = LoadCursor (NULL, IDC_ARROW) ; 
wndclass. hbrBackground = GetStockObject (WHITE_BRUSH) ; 
wndclass. IpszMenuName = szAppName ; 
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wndclass.lpszCiassName = szAppName ; 

RegisterClass (&wndclass) ; 
} 

hwnd = CreateWindow (szAppName, 'Transformations", 
WS OVERLAPPEDWINDOW, 
cwjjsedefault, CW_USEDEFAULT, 

CW USEDEFAULT, CW_USEDEFAULT, 
NULL, NULL, hlnstance, NULL) ; 

ShowWindow (hwnd, nCmdShow) ; 
UpdateWindow (hwnd) ; 

while (GetMessage (&msg, NULL, 0, 0)j 
{ 

TranslateMessage (&msg) ; 
DispatchMessage (&msg) ; 
} 

return msg.wParam ; 

} 

long FAR PASCAL ^export WndProc (HWND hwnd, UINT message, UINT 
wParam, 

LONG IParam) 

{ 

staticchar szFileName [_MAX_PATH], 

szTitleName [_MAX_FNAME + _MAX_EXT] ; 
static char * szFilter[] = { "RGB Files (*.RGB)", '".rgb", 

-}; 

static OPENFILENAME ofn ; 

static FARPROC IpfnFramesProc ; 

static HANDLE hinst; 



HDC hdc ; 

PAINTSTRUCT 



ps; 



char 

WORD 

H PALETTE 

DWORD 

int 

char 

RECT 

DWORD 

int 

int 

int 

PHDR 



DebugString[100] ; 

cxClient, cyClient ; 

hpal ; 

U; 

k; 

RgbFileName[50] ; 
ToValidate.recp ; 

Size ; 
DstRows.DstCols ; 
ToCopy ; 
gaoi.raoi.baoi ; 
header ; 

cl53 
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BYTE huge * PtrRgb ; 

char DataBuffer[10],lnputBuffer[10] ; 

DCB deb ; 

static int kernel[] = { 

1,1,1, 

1,1,1, 

1,1,1}; 

switch (message) { 
case WM_CREATE: 
ofn.lStructSize = sizeof (OPENFILENAME) ; 
ofn.hwndOwner = hwnd ; 
ofn.lpstrFilter = szFilter [0] ; 
ofn.lpstrFile = szFileName ; 
ofn.nMaxFile = _MAX_PATH ; 

ofn.lpstrFileTitle = szTitieName ; 
ofn.nMaxFileTitle = _MAX_FNAME + _MAX_EXT ; 
ofn.lpstrDefExt = "bmp" ; 

hinst = ((LPCREATESTRUCT)IParam)->hlnstance ; 

IpfnFramesProc = 
MakeProclnstance((FARPROC)FrarnesDlg,hinst); 

IpfnTimeProc = MakeProclnstance((FARPROC)TimerProc,hinst); 

Igcpal.palNumEntries = 256 ; 

Igcpal.palVersion = 0x300 ; 

lgcpal.palPaIEntry[0].peRed = 0; 

lgcpal.paIPalEntry[oj.peGreen = 0; 

Igcpal.palPalEntryfoj.peBlue = 0; 

Igcpal.palPalEntryfOj.peFlags = PC_NOCOLLAPSE; 

hFile = OpenFile("map.dir,&of,OF_CREATE | OF_WRfTE) ; 

OriginSign.Bmap = NULL ; 

OriginSign.BmapGrey = NULL ; 
return 0 ; 
case WM SIZE: 

cxClient = LOWORD (IParam) ; 
cyClient = HIWORD (iParam) ; 
return 0 ; 
case WM_C O M M AN D : 

switch (wParam) { 

case IDMJDPEN: 

ofn.ipstrlnitialDir = "c:\\work\\trans"; 
if (GetOpenFileName (&ofn)) { 

FileType = get_file_type_by_name(szFileName) ; 
if ( FileType == FILE_IS_RGB ) { " 

load_picture_from_file(hwnd,szFileName) ;- 
InvalidateRect (hwnd, NULL/TRUE) ; 

} 

} 
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case IDMJA/RITE: 

ofn.lpstrlnitialDir = "c:\\work\\trans"; 
if (GetOpenFileName (&ofn)) { 

FileType = get_file_type_by_name(szFileName) ; 
if ( FileType == FILE_IS_RGB ) { 

WriteRgb (hwnd.szFileName.SrcBmap) ; 
} else { 

MessageBox (hwnd, "File must be .rgb", 
szAppNaroe, MBJCONEXCLAMATION | 

MB_OK) ; 

} 

} 

break ; 
case !DM_PICK_SUBST: 

if(SrcBmap == NULL ) { 

MessageBox (hwnd, "No Source Bitmap", 

szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

UnderPicking = 1 ; 
CurrP = 0 ; 
SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL, IDC_CROSS)) ; 
break; 
case IDM_PICK ORIG: 

if ( SrcBmap == NULL ) { 

MessageBox (hwnd, "No Source Bitmap", 

szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

UnderOrig = 1 ; 
CurrP = 0 ; 
SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL,IDC_CROSS)) ; 
break ; 

case IDM_PICK_CORNERS: 
if ( SrcBmap == NULL ) { 

MessageBox (hwnd, "No Source Bitmap", 
szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

UnderCorners = 1 ; 
CurrP = 0 ; 
SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL,!DC_CROSS)) ; 
break ; 
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case IDM_LOAD_ORIG: 

ReadSign( hwnd,"orig.sgn",&OriginSign) ; 
break ; 
case IDM_CHANGE: 

UnderChanging = 1 ; 
if ( IpSubst == NULL ) { 

MessageBox (hwnd, "No Model Bitmap", 

szAppName, MB_ICONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL,IDC_CROSS)) ; 

break ; 
case IDM_BILINEAR: 

InterpMode = IN_BILINEAR ; 

break ; 
case IDM_TRILINEAR: 

InterpMode = IN_TRILINEAR ; 

break ; 
case !DM_SPLIT: 

SplitMode = 1 - SplitMode ; 

break ; 
case IDMJNFO: 

display_information(hwnd) ; 

break ; 
case ID M_START_TRACK: 

UnderTracking = 1 ; 

OriginSign.TrPoints.NumOfPoints = 0 ; 

TrackBase.NumOfPoints = 0 ; 

TrackCurr.NumOfPoints = 0 ; 

SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL,IDC_CROSS)) ; 
break ; 
case I D M_AUT 0_TRAC K: 
//Ticks = GetTickCount() ; 
change_sign_by_tracking(hwnd,1 ) ; 
//sprintf(DebugString,'Track+Change %ld", 
// GetTickCount()-Ticks) ; 
//MessageBox (hwnd, DebugString, 
// szAppName, MB_I C O N EXC LAM ATI O N | 

MB_OK) ; 

break ; 
case DISPJNIT: 

mfg_loadcnf('"') ; 

mfg_init() ; 

Waslnit = 1 ; 

break ; 
case DISP SNAP: 
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if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

mfg_setvframe(RGB) ; 
mfg_dacmode(TRUE_24); 
mfg_snap(CAMERA,PAGE1) ; 
break ; 
case DISP_GRAB: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB JDK); 

break ; 

} 

mfg_setvframe(RGB) ; 
mfg_dacmode(TRUE_24); 
mfg_grab(CAMERA,PAGE1) ; 
break ; 
case DISP_DRAW: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB JDK); 

break ; 

drawJo_screen(SrcBmap,0,SrcBmap->rows) ; 
//drawJo_screen(SrcBmap, 1 20,200) ; 
break ; 
case DISP_CLEAN: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB JDK) ; 

break ; 

} 

SetCapture(hwnd) ; 

SetCursor(LoadCursor(NULL,IDC_CROSS)) ; 
InClean = 1 ; 
break ; 
case DISP_WIPE: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB_OK); 

break ; 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 PCT/US94/01679 



mfg_wipe(0) ; 
InSerieMode = 1 ; 
//create_subs_sign(hwnd) ; 
SetTirner(hwnd,1,500,lpfnTimeProc) ; //To Be 

REMOVED 

break ; 
case DISP_LOAD: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

//load_picture_from_card(hwnd) ; 
sprintf(RgbFileName,"pict%d.rgb ,, 1 PictCount++) ; 
WriteRgb (hwnd.RgbFileName.SrcBmap); 
InvaiidateRect (hwnd, NULL, TRUE) ; 
break ; 

case DISP_LOAD_FIELD: 
if ( Waslnit == 0 ) { 

MessageBox (hwnd, "Need to Initialize MFG", 
szAppName, MBJCONEXCLAMATION | 

MB_OK) ; 

break ; 

} 

load_field_from_card(hwnd,0) ; 

InvaiidateRect (hwnd, NULL, TRUE) ; 

break ; ■ 
case SONYJNIT: 

PortNumber = OpenComm("COM2", 1024, 128) ; 

sprintf(DebugString."PortNumber %d", PortNumber) ; 

MessageBox (hwnd, DebugString, 

szAppName, MBJCONEXCLAMATION | MB_OK) ; 

k= BuildCommDCB("COM2: 1 200,n,8, 1 ", &dcb) ; 

k = SetCommState(&dcb) ; 

break ; 
case SONY_FRAME: 

if ( DiaiogBox(hinst,"frames",hwnd,lpfnFramesProc) ) { 
sscanf(stBufferWidth,"%d", SFromFr) ; 
sscanf(stBufferHeight,"%d",&ToFr) ; 

//SonySearch(hwnd,FromFr, PortNumber) ; 
//TimeElapsed = 0 ; 
//SetTimer(hwnd,1,500,lpfnTimeProc) ; 
break ; 
case SONY_RECORD: 

ReplaceFlag = 1 - ReplaceFlag ; 
//SonyRecord(hwnd, PortNumber) ; 
break ; 
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case SONY_END: 

k = CloseComm(PortNumber) ; 
break ; 

> 

break; 

case WM_LBUTTONDOWN: 
if ( UnderPicking == 1 ) { 
pick_sign(hwnd,message,wParam,IParam) ; 

If ( UnderOrig == 1 ) { 

pick_original(hwnd,message,wParam,IParam) ; 

If ( UnderCorners == 1 ) { 

pic^comersthwnd.message.wParam.lParam) ; 

If ( UnderChanging == 1 ) { 

change_sign(hwnd, message.wParam, I Param) ; 

if ( UnderTracking == 1 ) { 

add_tracking_point(hwnd,message,wParam,IParam) ; 

} 

if ( InClean == 1 ) { 

add_clean_points(hwnd 1 message,wParam,IParam) ; 

} 

return 0 ; 
case WM_RBUTTONDOWN: 
if ( UnderTracking == 1 ) { 

SetCursor(LoadCursor(NULL,lDC_ARROW)) ; 

ReleaseCapture() ; 
UnderTracking = 0 ; 

create_lum_bmap(OriginSign.Bmap, &(OriginSign.BmapGrey)) ; 
WriteSign(hwnd,"orig.sgn",&OriginSign) ; 

} 

return 0 ; 
case WM_MOUSEMOVE: 

if ( UnderPicking == 1 || UnderChanging == 1 || UnderOng == 1) 



sprintf(DebugString,"%d,%d" l LOWORD(IParam),HIWORD(lParam)); 
recp.lefl = recp.top = 400 ; 
recp. bottom = 420 ; 
recp.right = 480 ; 

lnvalidateRect(hwnd,&recp,TRUE) ; 

} 

return 0 ; 
case WM_PAINT: 

if ( InSerieMode == 1 ) { 

hdc = BeginPaint (hwnd, &ps) ; 
EndPaint (hwnd, &ps) ; 
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break ; 

} 

hdc = BeginPaint (hwnd, &ps) ; 
ToValidate = ps.rcPaint ; 

if ( UnderPicking == 1 || UnderChanging == 1 || UnderOrig == 1) { 
TextOutfhdc.ToValidate.left.ToValidate.top.DebugString.lstrlenCDebugString)) 
} else { 

if ( SrcBmap != NULL ) { 

glhpal = CreatePalette(&lgcpal) ; 
if ( glhpal == NULL ) 
MessageBox (hwnd, "PALLET NOT CREATED", 
szAppName, MBJCONEXCLAMATION | MB_OK) ; 

SetPaletteEntries(gIhpal,0,256,ppalentr); 
hpalprev = SelectPalette(hdc, glhpal, FALSE) ; 
RealizePalette(hdc) ; 

if ( bitmap Jbr_display(hwnd,hdc,SrcBmap,ToVaiidate) == 0) { 
DeleteObject(glhpal) ; 
EndPaint (hwnd, &ps) ; 
return 0 ; 

} 

SetStretchBltMode(hdc.COLORONCOLOR) ; 
SetDIBitsToDevice(hdc,0.0,Dispmap->cols. 

Dispmap->rows,0 1 0,0,Dispmap->rows, 

(LPSTR)(Dispmap->gpic), 

(LPBITMAPiNFO)lpDisplay, DIB_RGB_COLORS) ; 
DeleteObject(glhpal) ; 

} 

} // End Of Else 
EndPaint (hwnd, &ps) ; 
return 0 ; 

case WM_DESTROY: 
Jclose(hFile) ; 
if ( IpDisplay != NULL ) { 

GlobalFreePtr(lpDisplay) ; 

} 

bm_free(SrcBmap) ; 

bm_free(SrcLumap) ; 

bm_free(Dispmap) ; 

bm_free(Normap) ; 

bm_free(SubstBmap) ; 

bm_free(Subs) ; 

bm__free(MskBmap) ; 

WIITimer(hwnd,1) ; 
PostQuitMessage (0) ; 
return 0 ; 
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return DefWindowProc (hwnd, message wParam, IParam) ; 

} 

int PASCAL teach_grey_pallete(HWND hwnd, int Entries) 
{ 

int i; 

UINT re ; 

char Debug[100]; 

if ( ppalentr != NULL ) { 
GlobalFreePtr(ppalentr) ; 
ppalentr = NULL ; 

ppalentr = (PALETTEENTRY FAR • ) GlobalAllocPtr (GMEM_MOVEABLE 
HH ,Entries*sizeof(RGBQUAD)) ; 

for ( i = 0 ; i < Entries ; i++ ) { 

ppalentnj].peRed = i ; 

ppalentrfjj.peGreen = i ; 

ppalentr[i].peBlue = i ; 

ppa!entr[i].peFlags = PC_NOCOLLAPSE ; 

} 

return 1 ; 

} * 

int PASCAL get_in_series_flag() 
{ 

return InSerieMode ; 

} 

int PASCAL display_information(HWND hwnd) 
{ 

char Debug[100] ; 

if ( SrcBmap == NULL ) { 

MessageBox (hwnd, "No Source Bitmap , szAppName, 

9 V MBJCONEXCLAMATION | MB_OK) ; 

return 1 ; 

} 

sprintf(Debug,"Width =%d Height = %d ", SrcBmap->cols,SrcBmap->rows) ; 

MeTsageBox (hwnd, Debug, szAppName, MBJCONEXCLAMATION | 
MB_OK) ; 

return 1 ; 
} 

31W 
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BOOL FAR PASCAL _export FramesDlg(HWND hdlg.UINT message.UINT 
wParam, 

LONG IParam) 

{ 

switch ( message ) { 
case WMJNITDIALOG: 

return TRUE ; 
case WM_COMMAND: 
switch ( wParam) { 

case SONY_FROM_FR: 

GetDlgltemText(hdlg,PER_WIDTH,(LPSTR)stBufferWidth,50) ; 
return TRUE ; 
break ; 
case SONY_TO_FR: 

GetDlgltemText(hdlg,PER_HEIGHT,(LPSTR)stBufferHeight,50); 

return TRUE; 

break ; 
caseSONYJDK: 

EndDialog(hdlg.TRUE) ; 

return TRUE ; 

break ; 
case S 0 N Y_C AN C EL: 

EndDialog(hdlg, FALSE) ; 

return TRUE; 

break ; 

} 

} 

return FALSE ; 



BYTE huge * ReadRGB(HWND hwnd.char * FileName.int *Width,int Height) 
{ 

HFILE hFiie ; 

PHDR phdr; 

DWORD Size ; 

HDC hdc ; 

DWORD offset ; 

DWORD i, j ; 

BYTE Red.Green.Blue ; 

H PALETTE hpal ; 

int ColorFactor ; 

BYTE huge * PtrRgb ; 

BYTE huge * IpRead ; 

int SizeToRead ; . 
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int Incr; 

if (_1 == (hFile = Jopen (FileName, OF_READ | 
OF_SHARE_DENY_WRITE))) 
return NULL ; 
Jread (hFile, (LPSTR) &phdr, sizeof (PHDR)) ; 
if ( glModelColor == GREY_MODEL ) ColorFactor = 1 ; 
if ( glModelColor == COLOR_MODEL ) ColorFactor = 3 ; 
Size = (DWORD)phdr.cols*(DWORD)phdr.rows*(DWORD)ColorFactor ; 
•Width = phdr.cols ; 
•Height = phdr.rows ; 

IpRgb = (BYTE huge * ) GlobalAIiocPtr (GMEM_MOVEABLE, Size) ; 
PtrRgb = IpRgb ; 
offset = 0 ; 

SizeToRead = (DWORD)(phdr.cols)'(DWORD)3 ; 
IpRead = (BYTE huge * ) GlobalAIiocPtr ( G M E M_M 0 VEAB LE, 
SizeToRead) ; 

while ( offset < Size ) { 

if (glModelColor == GREY_MODEL) { 
Jread(hFile,(LPSTR)lpRead,SizeToRead) ; 
for ( i = 0 ; i < SizeToRead ; i+= 3 ) { 
•(PtrRgb+offset) = (*(lpRead+i)+*(lpRead+i+1)+ 
*(lpRead+i+2))/3 ; 

offset++ ; 

} 

}else{ // COLOR_MODEL 
Jread(hFile,(LPSTR)(PtrRgb+offset), SizeToRead) ; 
offset += SizeToRead ; 

} 

} 

GlobalFreePtr (IpRead) ; 
if (glModelColor == GREY_MODEL) { 
teach_grey_pallete(hwnd, 256) ; 
}else{ 

teach_rgb_pallete(hwnd) ; 

} 

Jclose(hFile) ; 
return PtrRgb ; 

} 



int PASCAL teach_rgb_pallete(HWND hwnd) 
{ 

int pl.i j,k ; 

int red, blue, green ; 

UINT re ; 

char Debug[100]; 

int Scale[6] = {0,64, 1 28, 1 50, 1 92,255} ; 

int Fine[4] = {32,96,171,224}; 
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if ( ppalentr != NULL ) { 
GlobalFreePtr(ppalentr) ; 
ppalentr = NULL ; 

ppalentr = (PALETTEENTRY FAR * ) GIobalAllocPtr (GMEM_MOVEABLE 
PP v ,256-sizeof(RGBQUAD)) ; 

for(i = 10;i<245;i++){ 

ppalentr[i].peRed = i ; 

ppalentr[i].peGreen = i ; 

ppalentrfjj.peBlue = i ; 

ppalentr[i].peFlags = PC_RE SERVED ; 

} 

return 1 ; 
} 

int PASCAL get_file_type_by_name(char * FileName) 
{ 

int i.len ; 

len = strlen(FileName)-1 ; 
for ( i = len ; i > 0 ; i- ) { 
FileNamep] = toupper(FileName[i]) ; 
if ( FileNamep] =='.'){ 
i++ ; 
break ; 

} 

if ( strcmp(FileName+i,"RGB") == 0 ) return FILEJS.RGB ; 
return FILEJSJJN KNOWN ; 

} 

int PASCAL create_poly_src_dst() 
{ 

SrcPoly[0].x = SrcPoly[0].x = 0.0 ; 
SrcPoly[1].x = SubstBmap->cols ; // SubstCols ; 
SrcPoly[1].y = 0.0 ; 

SrcPoly[2].x = SubstBmap->cols ; //SubstCols ; 
SrcPoly[2].y = SubstBmap->rows ; //SubstRows ; 
SrcPoly[3].x = 0.0 ; 

SrcPoly[3].y = SubstBmap->rows ; //SubstRows ; 

Lcpjnt_arr_to_RPOINT(DstPoly, OrgX, OrgY,4) ; 
: return 1 ; 
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} 



int PASCAL keep_subst(HWND hwnd, MYB ITMAP *Bmap) 
{ 

DWORD i,j ; 
HFILE hFile ; 
PHDR phdr ; 
DWORD Size ; 
DWORD offset ; 
DWORD Cols ; 
BYTE huge * Ptr ; 
DWORD Width.Adjust ; 

SubstCols = phdr.cols = abs(OrgX[1] - OrgX[0]) ; 
SubstRows = phdr.rows = abs(OrgY[2] - OrgY[1]) ; 
phdr.bp = 3 ; 

Size = (DWORD)(phdr.cols) # (DWORD)(phdr.rows)*(DWORD)3 ; 
IpSubst = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 
offset = 0; 

Cols = (DWORD)(phdr.cols)*(DWORD)3 ; 
Ptr = Bmap->gpic ; 

Width = (DWORD)(SrcBmap->cols)*(DWORD)3 ; 
Adjust = (DWORD)(OrgX[0])-(DWORD)3 ; 

for ( i = 0 ; i < phdr.rows ; i++ ).{ 
for ( j = 0 ; j< Cols ; j++ ) {• 

•(IpSubst + offset+j) = *(Ptr+ 

((DWORD)Width*(DWORD)(OrgY[0]+i)) + Adjust + j) ; 

} 

offset += Cols ; 

SubstBmap = bm_alloc(SubstCols,SubstRows,gIModelColor); 
SubstBmap->gpic = IpSubst ; 
return 1 ; 

} 

int PASCAL keep_orig(HWND hwnd, MYB ITMAP *Bmap) 
{ 

DWORD i j ; 
HFILE hFile ; 
PHDR phdr; 
DWORD Size ; 
DWORD offset ; 
BYTE huge* IpModel ; 
DWORD Cols ; 
BYTE huge * Ptr ; 
DWORD Width,Adjust ; 
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OrigCols = phdr.cols = abs(OrgX[1] - OrgX[0]) ; 
OrigRows = phdr.rows = abs(OrgY[2] - 0rgY{1]) ; 
phdr.bp = 24 ; 

Size = (DWORD)(phdr.co!s)*(DWORD)(phdr.rows)-(DWORD)3 ; 
IpModel = (BYTE huge-)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 
offset = 0 ; 

Cols = (DWORD)(phdr.cols)*(DWORD)3 ; 
Ptr = Bmap->gpic ; 

Width = (DWORD)(SrcBmap->cols)*(DW0RD)3 ; 
Adjust = (DWORD)(OrgX[0])*(DWORD)3 ; 

for ( i = 0 ; i < phdr.rows ; i++ ) { 
Ptr = Bmap->gpic + ((DWORD)Width*(DWORD)(OrgY[0]+i)) + Adjust ; 
for ( j = 0 ; j< Cols ;]++){ 

*(lpModel + offset+j) = *(Ptr++) ; 

} 

offset += Cols ; 

} 

bm_free(OriginSign.Bmap) ; 
bm__free(OriginSign.BmapGrey) ; 

OriginSign.Bmap = bm_alloc(OrigCols,OrigRows,glModeIColor); 
OriginSign.Bmap->gpic = IpModel ; 
WriteRgb (hwnd,"orig.rgb",OriginSign.Bmap); 
return 1 ; 
} 



int PASCAL bitmap_for_display(HWND hwnd, HDC hdc,MYBITMAP FAR 

*Bmap,RECT ToValidate) 

{ 

LONG Size.ij ; 
BYTE huge * TmpB ; 
BYTE huge * Tmp ; 
BYTE huge * Ptr ; 
char Debug[100] ; 

GetSystemPaletteEntries(hdc,(UINT)0,(UINT)256,ppalsys) ; 
Size = 40 +(DWORD)(sizeof(RGBQUAD)r(DWORD)256 ; 

if ( IpDisplay != NULL ) { 
GlobalFreePtr(lpDisplay) ; 

IpDisplay = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 
IpBits = IpDisplay + 40+(DWORD)(sizeof(RGBQUAD))*(DWORD)256 ; 
Ptr = IpDisplay +40 ; 
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((BITMAPINFOHEADER huge*)lpDisplay)->biSize = 40 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biWidth = Bmap->cols ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biHeight =Bmap->rows ; 
((BITMAPINFOHEADER huge-)lpDisplay)->biPlanes = 1 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biBitCount = 8 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biCompression = 0 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biSizelmage = 0 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biXPelsPerMeter = 0 ; 
((BITMAPINFOHEADER huge-)lpDisplay)->biYPelsPerMeter = 0 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biClrUsed = 0 ; 
((BITMAPINFOHEADER huge*)lpDisplay)->biClrlmportant = 0 ; 

for ( i = 0 ; i < 256 ; i++ ) { 
(BYTE)*(Ptr + (DWORD)(i*sizeof(RGBQUAD))) = ppalsys[i].peBlue; 
( BYTE )*( Ptr + (DWORD)(i*sizeof(RGBQUAD)+1))= ppalsys[i].peGreen; 
(BYTE)'(Ptr + (DWORD)(i*sizeof(RGBQUAD)+2))= ppalsys[i].peRed; 
(BYTEHPtr + (DWORD)(i*sizeof(RGBQUAD)+3)) = 0 ; 

} 

return (create_disp_bmap(Bmap, &Dispmap,ToValidate)) ; 

} 

int PASCAL draw_to_screen(MYBITMAP *Bmap,int FromLine.int ToLine) 
{ 

int i,j ; 

BYTE huge *Ptr ; 
BYTE huge *PtrR ; 
BYTE huge *PtrG ; 
BYTE huge *PtrB ; 
int Cols ; 

Cols = Bmap->cols ; 
Ptr = Bmap->gpic ; 

Ptr += (DWORD)FromLine*(DWORD)Cols*(DWORD)3 ; 
PtrR = Ptr ; 
PtrG = Ptr+1 ; 
PtrB = Ptr+2 ; 
mfg_setgframe(R); 
for ( i = FromLine ; i < ToLine ; i++ ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

rpixarrQ] = *PtrR ; 

PtrR += 3 ; 

} 

mfg_bwhline(PAGEO,0,i 1 Cols,rpixarr) ; 

} 

mfg_setgframe(G); 
for ( i = FromLine ; i < ToLine ; i++ ) { 
for ( j = 0 ; j < Cols ; j++ ) { 
rpixarrfl] = *PtrG ; 
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} 

mfg_bwhiine(PAGEO,0,i,Cols,rpixarr) ; 

} 

mfg_setgframe(B); 
for ( i = FromLine ; i < ToLine ; i++ ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

rpixarrQ] = "PtrB ; 

PtrB += 3 ; 

* mfg_bwhline(PAGE0 1 0 I i,Cois,rpixarr) ; 
} 

return 1 ; 

} 

int PASCAL create_disp_bmap(MYBITMAP *Bmap, MYBITMAP 

**LumBmap,RECT ToValidate) 

{ 

BYTE huge * Tmp; 

BYTE huge * TmpB ; 

int ToPad ; 

int Cols, Rows ; 

DWORD Size ; 

int i,j ; 

long k ; 

int RowLimit ; 

if ( Normap == NULL ) return 0 ; 
Cols = Bmap->cols ; 
Rows = Bmap->rows ; 

ToPad= Cois%4; 

if ( ToPad > 0 ) ToPad = 4 - ToPad ; 

Tmp = Bmap->gpic ; 

if ( ToValidate.top == 0 ) { 
if ( *LumBmap != NULL ) bm_free('TumBmap) ; 

•LumBmap = bm_alloc(Cols+ToPad,Rows,GREY MODEL); 
Size = (DWORD)(Cols+ToPad)*(DWORD)Rows " 
(*LumBmap)->gpic = (BYTE 
huge*)GlobalAllocPtr(GMEM__MOVEABLE,Size) ; 



RowLimit = min(Rows,ToValidate.bottom) ; 
for ( i = RowLimit ; i> ToValidate.top ; i- ) { 
Tmp = Normap->gpic +(DWORD)(i-ir(DWORD)Cols ; 

aw 
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TmpB = (*LumBmap)->gpic+(Rows-i)*(DWORD)(Cols+ToPad) ; 
for ( j = 0 ; j < Cols ; j++ ) { 
*(TmpB++) = *(Tmp++) ; 

} 

for ( j = 0 ; j < ToPad ; j++ ) { 
*(TmpB++) = 0 ; 

} 

} 

return 1 : 

} 

int PASCAL pick_sign(HWND hwnd, UINT message, UINT wParam, LONG 

IParam) 

{ 

OrgXfCurrP] = LOWORD(IParam); 
OrgY[CurrP] = HIWORD(IParam); 
CurrP++ ; 
if ( CurrP == 2 ) { 

OrgX[2] = OrgX[1]; 

OrgY[2] = OrgY[1] ; 

OrgY[1] = OrgY[0] ; 

OrgX[3] = OrgX[0] ; 

OrgY[3] = OrgY[2] ; 

UnderPicking = 0 ; 

CurrP = 0 ; 

SetCursor(LoadCursor(NULL,IDC_ARROW)) ; 
ReleaseCapture() ; 
keep_subst(hwnd,SrcBmap) ; 
if ( InterpMode == INJTRiLINEAR ) 

buiId_pyramidThwnd,SubstBmap) ; 

} 

return 1 ; 
> 

int PASCAL add_clean_points(HWND hwnd, UINT message, UlNTwParam, 

LONG IParam) 

{ 

static int kernelQ = { 

1,1,1. 

1,1.1, 

1.1.1}: 
int gaoi.raoi.baoi ; 
int DifX,DifY ; 

CleanXJCIeanCount] = LOWORD(IParam); 
CleanYlCleanCount] = HIWORD(IParam); 
CleanCbunt++ ; -j/^i ' 
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if ( CleanCount == 2 ) { 
InClean = 0 ; 
CleanCount = 0 ; 

SetCursor(LoadCursor(NULL, IDC_WAIT)) ; 
DifX = CleanX[1]-CleanX[0] ; 
DifY = Clean Y[1]-CleanY[0] ; 

gaoi = mfg_gaoi_fbcreate(G I CleanX[0],CleanY[OJ I DifX,DifY) ; 
mfg_median(gaoi,gaoi,3,3,kernel) ; 

raoi = mfg_gaoi_fbcreate(R,CleanX[0],CleanY[0],DifX,DifY) ; 
mfg_median(raoi,raoi I 3,3 I kemel) ; . 

baoi = mfg_gaoi_fbcreate(B,CleanX[0] I CleanY[0],DifX,DifY) ; 
mfg_median(baoi,baoi,3,3,kemel) ; 
SetCursor(LoadCursor(NULL, IDC_ARROW)) ; 
ReleaseCapture() ; 
//SetTimer(hwnd,1,40,lpfnTimeProc) ; 

} 

return 1 ; 

} 

int PASCAL pick_corners(HWND hwnd, UINT message, UINT wParam, 

LONG IParam) 

{ 

RPOINT CoefsH1,CoefsH2,CoefsV1,CoefsV2 ; 
POINT Pointl ,Point2 ; 
char String[1 00] ; 

OrgXfCurrP] = LOWORD(IParam); 
OrgYICurrP] = HIWORD(lParam); 
CurrP++ ; 
if ( CurrP == 4 ) { 

UnderCorners = 0 ; 

CurrP = 0 ; 

SetCursor(LoadCursor(NULL,IDC_ARROW)) ; 
ReleaseCapture() ; 

} 

return 1 ; 
} 



int PASCAL pick_original(HWND hwnd, UINT message, UINT wParam, 

LONG IParam) 

{ 

RPOINT CoefsM ,CoefsH2,CoefsV1 ,CoefsV2 ; 
POINT Pointl, Point2 ; 
char String[1 00] ; 

OrgXfCurrP] = LOWORD(IParam); 

^70 
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OrgY[CurrP] = HIWORD(IParam); 

CurrP++ ; 

if ( CurrP == 2 ) { 

OrgX[2] = OrgX[1]; 

OrgY[2] = OrgY[1] ; 

OrgY[1]= OrgY[0]; 

OrgX[3] = OrgX[0] ; 

OrgY[3] = OrgY[2] ; 

UnderOrig = 0 ; 

CurrP = 0 ; 

SetCursor(LoadCursor(NULL,IDC_ARROW)) ; 
ReleaseCapture() ; 
keep_orig(hwnd,SrcBmap) ; 

} 

return 1 ; 

} 

int PASCAL change_sign(HWND hwnd, UINT message, UINT wParam, 

LONG IParam) 

{ 

RECT Bound ; 

RPOINTPtO,Pt1,Pt2,Pt3; 

POINT Pointl ,Point2 ; 

RPOINT SrcPnts[4] ; 

char String[100] ; 

DWORD FromTime.ToTime ; . 

EDGE Edge1,Edge2,Edge3,Edge4 ; 

char DebugString[50] ; 

MYBITMAP -AlphaMap ; 

OrgX[CurrP] = LOWORD(IParam); 
OrgYfCurrP] = HIWORD(!Param); 
CuitP-m- ; 
if ( CurrP == 4 ) { 

UnderChanging = 0 ; 

CurrP = 0 ; 

SetCursor(LoadCursor(NULLIDC_ARROW)) ; 
ReleaseCapture() ; 

create_poly_src_dst() ; 
l_find_bound_rect(DstPoly, &Bound) ; 

//create^as^bmapChwnd.OriginSign.BmapGrey.SrcPoly.DstPoiy.Bound.&M 
skBmap) ; 

//Ticks = GetTickCountO ; 

build_alpha_map(&AlphaMap, SrcBmap.DstPoly) ; 

//perspective_al(hwnd,SubstBmap,SrcBmap,AlphaMap,SrcPoly, 
^7! 
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// DstPoly, gIModelColor, SBasicTransf) ; 
bm_free(A!phaMap) ; 

perspective(hwnd, SubstBmap, SrcBmap, SrcPoly , 
DstPoly, gIModelColor, &BasicTransf) ; 
//sprintf(DebugString, "Change %ld",GetTickCount()-Ticks) ; 
//MessageBox (hwnd, DebugString, 

// szAppName, MBJCONEXCLAMATION | MB_0K) ; 
//perspective_mask(hwnd, SubstBmap, SrcBmap, SrcPoly, 
// DstPoly, gIModelColor, InterpMode.MskBmap) ; 

create_norm_bmap(hwnd,SrcBmap v &Normap, Bound) ; 
InvalidateRect (hwnd, &Bound, TRUE) ; 

} 

return 1 ; 

} 

int PASCAL add_tracking_point(HWND hwnd, U I NT message, UlNTwParam, 

LONGIParam) 

{ 

int Place ; 

Place = OriginSign.TrPoints.NumOfPoints ; 
if ( Place >= NUM_OF_TRACK_P0INTS ) { 

MessageBox (hwnd, "Cannot track more than 30 points", 

szAppName, MBJCONEXCLAMATION J MB_OK) ; 

SetCursor(LoadCursor(NULL,IDC_ARROW)) ; 

ReleaseCapture() ; 

UnderTracking = 0 ; 

createJum_bmap(OriginSign.Bmap, &(OriginSign.BmapGrey)) ; 
WriteSign(hwnd,"orig.sgn",&OriginSign) ; 
return 1 ; 

} 

OriginSign.TrPoints.TrackP[Place].x = LOWORD(IParam); 
OriginSign.TrPoints.TrackP[Placej.y = HIWORD(IParam); 
TrackBase.TrackP[Place].x = LOWORD(IParam); 
TrackBase.TrackP[Place].y = HIWORD(IParam); 
TrackCurr.TrackP[Place].x = LOWORD(IParam); 
TrackCurr.TrackP[Place].y = HIWORD(IParam); 
OriginSign.TrPoints.NumOfPoints++ ; 
TrackBase.NumOfPoints++ ; 
TrackCurr.NumOfPoints++ ; 

return 1 ; 

} 



int PASCAL change_sign_by_tracking(HWND hwnd, int ToDisplay) 
i 

Perspective_Transform NewTransf ; 
Perspective Transform Tp ; 

21% 
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Perspective_Transform TpCurr ; 
RECT Bound ; 
int i,k ; 

double DiffUp.DiffDown ; 
double u.v.w ; 
char String[100] ; 
int dx.dy ; 
DWORD Size ; 
int Cols, Rows ; 
RPOINT SrcPnts[4] ; 
RPOINT RPointln.RPointOut ; 
SHIFT Shift; 

SHIFT Shifts[NUM_OF_TRACK_POINTS]; 
double DstX.DstY ; 
RECT Rectan ; 
MYBITMAP *DestBmap ; 
RPOINT CmPoly[4] ; 
TRACK_POINTS ModelPoints ; 
TRACK_POINTS DBasePoints ; 
RPOINT D iff Arr[M AX_N 0_0 F_TR_Wl N] ; 
MYBITMAP *AlphaMap ; 

TR_WIN Windows[MAX_NO_OF_TR_WlN] ; 

//create_subs_sign(hwnd) ; 

sprintf(String,"\n\n\t\tNew Frame\n") ; 

lwrite(hFile,String,strlen(String)) ; 
|_cp_int_arr_to_RPOINT(SrcPnts, SignX, SignY,4) ; 

Quad2Quad(hwnd,SrcPnts,DstPoly,&TpCurr) ; 



|_find_bound_rect(DstPoly, &Rectan) ; 

Cols = Rectan. right-Rectan.left+1 ; 

Rows = Rectan.bottom-Rectan.top+1 ; 

DestBmap = bm_alloc(Cols,Rows,GREY_MODEL) ; 

l_quadjn - new_origin(CrnPoly,DstPoly.Rectan.left,Rectan.top,4); 

for ( i = 0 " i < 4 ; i++ ) { 
sDhntffSthng "%d: Dst %lf,%lf Cm %lf,%lf Src %lf,%lf\n", 

. i,DstPoly[i].x,DstPoly[i].y,CmPoly[i].x.CrnPoly[i].y. 
SrcPnts[i].x,SrcPnts[i].y) ; 
_lwrite(hFile, String.strlen(String)) ; 

Quad2Quad(hwnd,SrcPnts, CrnPoly.&Tp); 

2^3 
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TrackCurr.NumOf Points = 0 ; 
ModelPoints.NumOfPoints = 0; 
DBasePoints.NumOfPoints = 0 ; 

for ( i = k= 0 ; i < OriginSign.TrPoints.NumOfPoints ; i++ ) { 

RPointln.x = (double)OriginSignTrPoints.TrackP . .x ; 

RPointln.y = (double)OriginSign.TrPoints.TrackP[.].y ; 

RPointOut = fPerspective(RPointln, &Tp) ; 

if (RPointOutx <= CORR.WINDOWX || RPo.ntOut.x >= (Cols- 
roRR WINDOWX-1) ) continue ; 

if (RPointOuty <= CORR_WINDOWY || RPo.ntOut.y >= (Rows- 
CORR WINDOWY-1)) continue; 

Mode!Points.TrackP[k].x = (int)(RPo.ntOutx+0.5 , 

Mode!Points.TrackP[k].y = <int)(RPointOuty+0 5) ; 

?( M odelPoints.TrackP[k].x > RPointOut .> c ) { // To m.nus > DrffArr 
DiffArr[k].x = (double)ModelPoints.TrackP[k].x - RPointOutx , 

} e DiffArr[k].x = RPointOutx - (double)ModelPoints.TrackP[k].x ; 

If ( ModelPoints.TrackP[k].y > RPointOuty ){ 

DWAnWy = (double)ModelPoint S .TrackP[k].y - RPo.ntOuty ; 
"V else f 

D iffArr[k].y = RPointOuty -(doubie)M^^ : 

DBasePoints.TrackP[k].x = OriginSignTrPoints.TrackP[i] x; 
DBasePoints.TrackP[k].y = OriginSign.TrPornts.TrackP[i].y; 
RPointOut = fPerspective(RPointln, &TpCurr) ; 
TrackCurr.TrackP[k].x = (int)(RPointOutx+0.5) ; 
TrackCurr TrackP[kl.y = (int)(RPointOut.y+0.5) ; 
J^c^u^ckP W.x > RPointOutx ) { //To minus DrffArr 
DiffArr[k].x += (double)TrackCurr.TrackP[k].x - RPo.ntOutx ; 

} e DiffArr[k].x += RPointOutx - (double)TrackCurr.TrackP[k].x ; 

If ( TrackCurr.TrackP[k].y > RPointOuty ){ 

DiffArr[k].y += (doub!e)TrackCurr.TrackPlk].y - RPo.ntOuty ; 

} e DrffArr[k].y += RPointOuty - (double)TrackCurr.TrackP[k].y ; 
} 

k++; 

TrackCurr.NumOfPoints-M- ; 
DBasePoints.NumOfPoints++ ; 
ModelPoints.NumOfPoints++ ; 

P erspedive(hwnd.OriginSign.BmapGrey,DestBmap,S^ 

P CrnPoly, GREYJWODEL, &BasicTransf) , 

xvsolve(hvmd,Normap,DestBmap,Shins,Windows,9&Mod^^ 
xysoive^nw & f rackCurri&N ewTransf.hFile,&DBasePoints,DiffArr), 

#14 
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bm_free(DestBmap) ; 

% ( rir*(sii4 4 4iforl { %d -%lf>lf\n" i,SrcPnts[i].x. SrcPnts[i].y) ; 
lwrite(hFile,String,strlen(Stnng)) ; 
7/DstX=SrcPnts[i].x*NewTransf.Pf[0][0]+ ._..„... 
// SrcPnts[i].y - NewTransf.Pfl1][0] + NewTransf.Pfl2][0] , 

//DstY = SrcPnts[i].x * NewTransf.Pf[0][1] + i 
//DstY 5 > rc ^ n rc ^ nts[j] y . NewT ransf.PfI1][1] + NewTransf.Pfl2][1] ; 

//w = SrcPntsffl.x * NewTransf.PflO][2] + r ^ T „ r _. 
/, SrcPntsPl y * NewTransf.Pf[1][2] + NewTransf.Pf[2][2] ; 

DstX = CrnP*^ + NewTrans , Pf[2][0] : 

DstY = + NewTrans , Pf[2][1] : 

w=CmPoly[i].x*NewTransf.Pf[0][2}+ rwroim • 

CrnPoly[i].y * NewTransf.Pf[1][2] + NewTransf.PfI2][2] . 
DstPoly[i].x = DstX/w ; 

Jwrite(hFile,String,strlen(String}); 

} 

l_fmd_bound_rect(DstPoly, SGIBound) ; 
r OCCLUSION 

create_mask_bmap(hwnd,OriginSign.BmapGre y ,SrcPnts,DstPoly,GIBoL,nd,& 

MskBmap); 
fill_mask_rect(MskBmap) ; 
ValidateOccRects(MskBmap) ; 
copy_into_valid_ rectsQ ; 
*/ 

//Ticks = GetTickCount() ; 

build alpha.mapt&AlphaMap, SrcBmap, DstPoly) ; 
//WriteGreyRgb (hwnd,"alp.rgb",AlphaMap) ; 
SertivLal(hwnd 1 SubstBmap 1 SrcBma P AlphaMap.SrcPoly, 
DstPoly, gIModelColor, SBasicTransf) ; 

//perspeaiv e _m a sk(hwnd,SubstBmap.SrcBmap,AlphaMap,SrcPoly, 

"J ESTS DstPoly, gIModelColor, InterpMode.MskBmap) ; //TESTS 

£a£n ( aT^^ 
if ( ToDisplay == 1 ) { 

InvalidateRect (hwnd, &GIBound, TRUE) ; 

} 

return 1: ^ 
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} 



int PASCAL WriteRgb (HWND hwnd.char "szFileNarne.MYBITMAP 'Bmap) 
{ 

PHDR phdr; 
DWORD i, Offset ; 
long int Size ; 
HFILE hFile ; 
OFSTRUCT IpOpenBuff; 
UINT ToWrite; 

phdr. cols = Bmap->cols ; 
phdr. rows = Bmap->rows ; 
phdr. bp = 24 ; 

. Size = (DWORD)phdr. C ols*(DWORD)phdr.rows*pWORD)3 ; 

hFile = OpenFile(szFileName,&lpOpenBuff,OF_CREATE | OF_WRITE) , 
_iwrite(hFile,&phdr,sizeof(phdr)) ; 

Offset = 0 ; 

while ( Size > 0 ) { 

ToWrite = min(32768ul,Size) ; 

Jwrite(hFiie,Bmap->gpic+Offset,ToWrite) ; 

Offset += ToWrite ; 
Size — ToWrite ; 

} 

Jclose(hFile) ; 

return 1 ; 
} 

int PASCAL WriteGreyRgb (HWND hwnd.char *szFileNarne,MYBrTMAP 

*Bmap) 

{ 

PHDR phdr; 
DWORD i.Offset ; 
long int Size ; 
HFILE hFile ; 
OFSTRUCT IpOpenBuff; 
UINT ToWrite ; 
BYTE huge *RgbArr ; 
BYTE huge *GreyTmp ; 
BYTE huge "Tmp ; 
DWORD GreySize ; 

phdr.cols = Bmap->cols ; 
phdr.rows = Bmap->rows ; 

ai6 
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phdr.bp = 24 ; 

Size = (DWORD)phdr.e»ls-(DWORD)phdrTOWS*(DWORD)3 ; 
RnbArr = I BYTE huge*)GlobalA!locPtr(GMEM_MOVEABLE, Size) ; 

Jwrite(hFile,&phdr,sizeof(phdr)) ; 

Tmp = RgbArr ; 
GreyTmp = Bmap->gpic ; 

GreySize = (DWORD)phdr.cols*(DWORD)phdr.rows ; 
for ( i = 0 ; i < GreySize ; i++ ) { 

*(Tmp++) = *( GreyTmp) ; 

*(Tmp++) = '(GreyTmp) ; 

*(Tmp++) = *(GreyTmp++) ; 

} 



Offset = 0 ; 
while ( Size > 0 ) { 

ToWrite = min(32768uI,Size) ; 

Jwrite(hFile,RgbArr+Offset,ToWrite); 

Offset += ToWrite ; 

Size — ToWrite ; 

} 

Jclose(hFile) ; 
GlobaiFreePtr(RgbArr) ; 

return 1 ; 
} 



int PASCAL WriteSign (HWND hwnd.char *szFileName,SIGN *Sign) 
{ 

DWORD i, Number ; 
HFILE hFiie ; 
OFSTRUCT lpOpenBuff; 
char String[100] ; 

Number = Sign->TrPoints.NumOfPoints ; 
sDrintftStrinq "%05d\n",10*Nurnber+9+11) ; 

£?I^^RIe(«Ri;Name i &lpOpenB U fP.OF_CREATE | OF.WRITE) ; 

Jwrite(hFile,String,strlen(String)) ; 
JwriteihFiie^orig.rgbNn"^) ; 

sorintRStrina "%05d %05d %05d %05d %05d %05d %05d-%05cAn", 

OrgW^^^ 
Jwrite(hFile,String,strlen(Strihg)); 

sprintf(String."%05d\n", Number) ; 

an 
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_lwrite(hFile. String, strlen(String)) ; 
for ( i = 0 ; i < Number ; i++ ) { 

sprintf(String,"%4d %4d\n",Sign->TrPoints.TrackP[i].x, 

Sign->TrPoints.TrackP[i].y) ; 

Jwrite(hFile,String,strlen(String)) ; 

} 

Jclose(hFile) ; 

return 1 ; 
} 

int PASCAL ReadSign(HWND hwnd.char -szFiieName.SIGN *Sign) 
{ 

DWORD i.Number ; 
HFILE hFile ; 

OFSTRUCT IpOpenBuff; 
char String[100] ; 
int NumOfBytes ; 
int NumOfPoints ; 
int Xval.Yval ; 
int Width, Height; 
BYTE huge *Ptr ; 

hFile = OpenFile(szFileName,&!pOpenBuff, OF_READ) ; 
Jread(hFile,String,6) ; // Size of bytes in File. 
String[5] = \0' ; 

sscanf(String,"%d" I &NumOfBytes) ; 
Jread(hFile,String,9) ; // RGB File Name. 
String[8] = '\0' ; 

Ptr = ReadRGB(hwnd,String,&Width,&Height); 
bm_free(Sign->Bmap) ; 

Sign->Bmap = bm_alloc(Width,Height,glModelColor); 
Sign->Bmap->gpic = Ptr ; 

create Jum_bmap(Sign->Bmap, &(Sign->BmapGrey)) ; 
//WriteGreyRgb (hwnd,"greyorg.rgb" I Sign->BmapGrey) ; 



iread(hFile,String.48) ; 
sscanf(String "%d %d %d %d %d %d %d %d",&(SignXIO]),&(SignY[0]), 
^SignXllD.&CSignYllD.&CSignX^J.&CSignYTa]), 
&(SignX[3]),&(SignY[3])) ; 

Jread(hFile,String,6) ; // Number of Points. 
String[5] = '\0' ; 

sscanf(String 1 "%d",&NumOfPoints) ; 

for ( i = 0 ; i < NumOfPoints ; i++ ) { 
_lread(hFile.String,10) ; 
String[9] = '\0' ; 
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sscanf(String,"%d %d ,, .&Xval,&Yval) ; 
Sign->TrPoints.TrackP[i].x = Xval ; 
Sign->TrPoints.TrackP[i].y = Yval ; 

Sign->TrPoints.NumOfPoints = NumOfPoints ; 
Jclose(hFile) ; 

return 1 ; 
} 

int PASCAL create_norm_bmap(HWND hwnd.MYBITMAP *Bmap,MYBITMAP 

— NormBmap, w ,. , 4 , 

RECT ToValidate) 

{ 

BYTE huge * TmpNorm ; 
BYTE huge * Tmp ; 
int Cols.Rows ; 
DWORD Size ; 
long i.j.k ; 
int RowLimit ; 

Cols = Bmap->cols ; 
Rows = Bmap->rows ; 



if ( ToValidate.top == 0 ) { 
if ( -NormBmap != NULL ) bm_freerNormBmap) ; 

•NormBmap = bm_alloc(Cols,Rows,GREY_MODEL); 
Size = (DWORD)Cols*(DWORD)Rows ; 
(*NormBmap)->gpic = (BYTE 
huge-)GlobalAllocPtr(GMEM_MOVEABLE,Size); 

} 

RowLimit = min(RowsToValidate.bottom) ; 
i = ToValidate.top ; 

Tmp = Bmap->gpic +(DWORD)i*(DWORD)Cols*(DWORD)3 ; 
TmpNorm = (-NormBmap)->gpic+ (DWORD)i-(DWORD)Cols ; 
while ( i < RowLimit ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

-(TmpNorm++) = (BYTE)((double)r(Tmp++)r 0-299 + 
(double)TTmp++r 0.587 + (double)*(Tmp++) 0.1 14); 

} 

i++ ; 

} 

return 1 ; 
} 



an 
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int PASCAL create_mask_bmap(HWND hwnd.MYBITMAP 
•GreyMdIBmap.RPOINT *SrcPoly, 

RPOINT -DstPoly.RECT Bound. MYBITMAP 

**MaskBmap) 

MYBITMAP "BoundedBmap =NULL ; 

MYBITMAP *DiffBmap =NULL; 

int Tresh ; 

char String[100]; 

DWORD FromTime.ToTime ; 

DWORD Sum ; 

//WriteGreyRgb (hwnd I "model.rgb",GreyMdlBmap) ; 

create_grey_bounded_bitmap(Bound,Normap,&BoundedBmap) ;//Copy the 
area to 

// be changed into a 
//separate bitmap. 

//WriteGreyRgb (hwnd,"bound0.rgb",BoundedBmap) ; 



perspectivefhwnd.GreyMdlBmap.Norrnap.SrcPoly, 

DstPoly, GREY_MODEL, &BasicTransf) ; 
//perspective_near(hwnd,GreyMdIBmap,Normap,SrcPoiy, 
// DstPoly, GREY_MODEL, &BasicTransf) ; 

// Perform perspective 
// grey of the current sign 
// with itself into NormBmap. 
substract_bitmaps(Bound,Normap,BoundedBmap,&DiffBmap)' ; // Subtract 
BoundedBmap 

//from the transformed 
// sign area in NormBmap. 



sum_grey_bitmap_value(DiffBmap,&Sum) ; 
//sprintf(String,"Sum is %ld",Sum) ; 

//MessageBox (hwnd, String, szAppName, MB_ICONEXCLAMATION | 
MB_OK) ; 

//WriteGreyRgb (hwnd,"diff.rgb",DiffBmap) ; 

insert_grey_bounded_bitmap(Bound,BoundedBmap,Normap) ; // retrieve 
original 

//picture into Normap. 

median_filter_5(hwnd,DiffBmap) ; // Creates a median 

// filter on Diffbmap. 
WriteGreyRgb (hwnd,"diff1.rgb",DiffBmap) ; 

mo 
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// for occlusion. 




= %d",Tresh) ; 

f , szAppName, MBJCONEXCLAMATION | 



MB_OK) ; 

get_mask_bitmap(hwnd,DiffBmap,Tresh,MaskBmap) ; 
WriteGreyRgb (hwnd,"diff2.rgb" 1 *MaskBmap) ; 

bm_free(BoundedBmap) ; 
bm_free(DiffBmap) ; 

return 1 ; 
} 

int PASCAL SonySearch(HWND hwnd, int frame, int port) 



char str[6]; 
int i, input; 
const int N_TRY = 5; 
char DataBuffer[128] ; 
charlnputBuffer[128]; 
int len ; 
int ErrCode ; 
char String[50] ; 
COMSTAT IpStat ; 

sprintf(str,"%05d",frame); 

DataBuffer[0] = 0x43 ; // Search 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 

ReadComm(port,lnputBuffer,1) ; 

ErrCode = GetCommError(port,&lpStat) ; 



MB_OK) ; 
} 

DataBuffer[0] = 0x55 ; // Frame mode 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( inputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

} 

for(i = 0: i< 5; { 



{ 




5i«l 
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DataBufferfO] = strp] ; // Integer 
WriteComm(port,DataBuffer, 1); 
InputBufferfO] = OxOO ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

} 

} 

DataBuffer[0] = 0x40 ; // Enter 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBijffer,1) ; 

} 

lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != 0x01 ) { 
ReadComrn(port,lnputBuffer,1) ; 

} 

retum((int)(lnputBuffer[0])); 

} 



int PASCAL SonyRecord(HWND hwnd, int port) 
{ 

char str[6]; 

int i, input; 

const int N_TRY = 5; 

BYTE DataBuffer[128]; 

char lnputBuffer[128]; 

int len ; 

char String[50] ; 
int ErrCode ; 
COMSTAT IpStat; 

//sprintf(String t "Before Frame Mode") ; 

//MessageBox (hwnd, String. szAppName, MBJCONEXCLAMATION | 
MB_OK) ; 

DataBuffer[0] = 0x55 ;// FRAME # MODE 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

//ErrCode = GetCommError(port,&lpStat) ; 

//sprintf(String."Error Code = %d",ErrCode) ; 

//MessageBox (hwnd, String, szAppName, MBJCONEXCLAMATION | 
MB JDK) ; . 

} 
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//sprintf(String,"After Frame Mode") ; 

//MessageBox (hwnd, String, szAppName, MBJCONEXCLAMATION | 
MB OK); 

DataBufferfO] = OxEF ; // BLANK SEARCH DISABLE 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

//sprintf(String, "After Blank enable Mode") ; 

//MessageBox (hwnd, String, szAppName, MBJCONEXCLAMATION | 
MB_OK) ; 

sprintf(str,"%05ld", RecFrame); 
sprintf(String,"STR = -%s"*',str) ; 



DataBuffer[0] = OxEO ; // REC StndBy 
WriteComm(port,DataBuffer, 1); 
InputBufferfO] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

while ( lnputBuffer[0] != 0x01 ) { 
ReadComm(port,lnputBuffer,1) ; 

//sprintf(String,"After Rec StandBy") ; 

//MessageBox (hwnd, String, szAppName, MBJCONEXCLAMATION | 
MB_OK) ; 

for(i = 0; i< 5; { 
DataBuffer[0] = str[i] ; // Integer 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

} 

} 

DataBuffer[0] = 0x40 ; // Enter 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = OxOO ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port, InputBuffer, 1 ) ; 

} 

RecFrame++ ; 

sprintf(str,"%05ld", RecFrame); 
for(i = 0: i < 5; i++) { 
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DataBuffer[Oj = str[i] ; // Integer 
WriteComm(port,DataBuffer. 1); 
lnputBuffer[0] = OxOO ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

} 

DataBufferfO] = 0x40 ; // Enter 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( InputBuffertO] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

DataBuffer[0] = 0x40 ; // Enter 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

InputBuffertO] = 0x00 ; 
while ( lnputBuffer[0] != 0x01 ) { 
ReadComm(port,lnputBuffer I 1) ; 

DataBuffer[0] = 0xE6 ; // Frame Rec Mode 
WriteComm(port,DataBuffer, 1); 
InputBuffertO] = 0x00 ; 
while ( lnputBuffer[0] != OxOA ) { 
ReadComm(port,lnputBuffer,1) ; 

DataBuffer[0] = 0xE9 ; // Record 
WriteComm(port,DataBuffer, 1); 
lnputBuffer[0] = 0x00 ; 
while ( InputBuffertO] != OxOA ) { 
ReadComm(port,lnputBuffer.1) ; 

InputBuffertO] = 0x00 ; 
while ( InputBuffertO] != 0x01 ) { 
ReadComm(port t lnputBuffer,1) ; 

} 

return((int)(lnputBuffer[0])); 

} 

static char RgbFileName[50] ; 

UINT FAR PASCAL .export TimerProc(HWND hwnd, UINT message.UINT 
wParam ' LONGIParam) 

a$+ 
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{ 

DWORD Sum ; 
inti; 

switch ( TimeElapsed ) { 
case 0: 

Kiinimer(hwnd,1) ; 
if ( PictCount >= ToFr ) { 
InSerieMode = 0 ; 
break ; 

sprintf(RgbFileName,"pict%d.rgb",PictCount++) ; 
ioad^icture_from_file(hwnd, RgbFileName) ; 
TimeElapsed++ ; 

SetTimer(hwnd,1 ,40,lpfnTimeProc) ; 
break ; 
case 1: 

Ki!ITimer(hwnd,1) ; 

//SendMessage(hwnd,WM_COMMAND,IDM_ALrrO_TRACK,0) ; 
if ( DummyFrames < DYMMIES ) { 

DummyFrames++ ; 

TimeElapsed++ ; 

SetTimer(hwnd,1 ,40,lpfnTimeProc) ; 
break ; 

} 

if ( ReplaceFlag == 1 ) { 

change_sign_by_tracking(hwnd,0) ; 

} 

TimeElapsed++ ; 

SetTimer(hwnd,1 ,40,!pfnTimeProc) ; 
break ; 
case 2: 

KiHTimer(hwnd,1) ; 

draw_fieid_to_screen(hwnd,SrcBmap,lsOddLine) ; 
//draw_to_screen(SrcBmap,0,SrcBmap->cols) ; 
TimeElapsed++ ; 

SetTimer(hwnd,1 ,40,lpfnTimeProc) ; 
break ; 
case 3: 

KiIITimer(hwnd,1) ; 

if ( IsOddLine == 1 ) { /lun [ li 
SonyRecord(hwnd,PortNumber) ; //TTTTTTT 
//IsOddLine = 1 - IsOddLine ; 
//TimeElapsed = 0 ; 
//break ; 

} // I i I I I I I I 

IsOddLine = 1 - IsOddLine ; 
TimeElapsed++ ; 

SetTimer(hwnd, 1 , 1 000. IpfnTimeProc) ; 
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break ; 
case 4: 

TimeElapsed++ ; 

break ; 
default: 

TimeElapsed = 0 ; 

break ; 

} 

return 1 ; 
} 



UINT FAR PASCAL _export TimerProc(HWND hwnd, UINT message.UINT 
wParam, 

LONG IParam) 

{ 

DWORD Sum ; 
int i ; 

switch ( TimeElapsed ) { 
case 0: 

KHffimer(hwnd,1) ; 

//MessageBox (hwnd, "Before Search", szAppName, 
MBJCONEXCLAMATION | MB_OK) ; 

SonySearch(hwnd, SearchFrame.PortNumber) ; 
SearchFrame++ ; 

//MessageBox (hwnd, "After Search", szAppName, 
MBJCONEXCLAMATION | MB_OK) ; 
mfg_setvframe(RGB) ; 
mfg_dacmode(TRUE_24); 
TimeElapsed++ ; 
mfg_snap(CAMERA,PAGE1) ; 
SetTimer(hwnd, 1 ,40,lpfnTimeProc) ; 
break ; 
easel: 

Kiimmer(hwnd,1) ; 

if ( PictCount >= ToFr ) { 

InSerieMode = 0 ; 

break ; 

sprintf(RgbFiIeName,"pict%d.rgb",PictCount-M-) ; 
load_field_from_card(hwnd,0) ; 
WriteRgb (hwnd.RgbFileName.SrcBmap) ; 
sprintf(RgbFileName,"pict%d.rgb",PictCount++) ; 
load_field_from_card(hwnd,1) ; 
WriteRgb (hwnd.RgbFileName.SrcBmap) ; 
SetTimer(hwnd,1 ,40.lpfnTimeProc) ; 
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TimeElapsed++ ; 
break ; 
default 

TimeElapsed = 0 ; 
break ; 

} 

return 1 : 
} 
•/ 

int PASCAL load_field_from_card(HWND hwnd.int NumOfField) 
{ 

DWORD Size ; 
BYTE huge 'RedBytes ; 
BYTE huge *GreenBytes ; 
BYTE huge "Blue Bytes ; 
int j,k ; 

DWORD Ticks ; 
char String[50] ; 



Ticks = GetTickCount() ; 

//Size = (DWORD)572*(DWORD)768-(DWORD)3 ; 
Size = (DWORD)286*(DWORD)768-(DWORD)3 ; 
if ( SrcBmap != NULL ) bm_free(SrcBmap) ; 

RedBytes = SrcBmap->gpic ; 
GreenBytes = SrcBmap->gpic+1 ; 
BlueBytes = SrcBmap->gpic+2 ; 
mfg_setgframe(R); 

for ( k = NumOfField ; k < 572 ;k++ ) { 
mfg.brhline(PAGE0,0,k++.768,rpixarr); 
for fj = 0 ; j < 768 ; j++ ) { 
•RedBytes = rpixarr0] ; 
RedBytes += 3 ; 

} 

mfg_setgframe(G); 

for ( k = NumOfField ; k < 572 ;k++ ) { 
mfa_brhline(PAGE0,0,k++,768 1 rpixarr) ; 
for~(j = 0; j <768;j++){ 
•GreenBytes = rpixarrQ] ; 
GreenBytes += 3 ; 

} 

} 

mfg_setgframe(B): 

for ( k = NumOfField ; k < 572 ;k++ ) { 
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mfg_brhline(PAGE0,O,k-M-,768,rpixarr); 
for(j = 0;j<768;j++){ 

•BlueBytes = rpixarr[j] ; 

BlueBytes += 3 ; 

> 

} 



MB_OK) ; 

teach_rgb_pallete(hwnd) ; 
FileType = FILE_IS_RGB ; 
GetClientRect(hwnd,&ClientRect) ; 
create_norm_bmap(hwnd,SrcBmap,&Normap,ClientRect) ; 

return 1 ; 

} 

int PASCAL load_picture_from_card(HWND hwnd) 
{ 

DWORD Size ; 

BYTE huge -RedBytes ; 

BYTE huge *GreenBytes ; 

BYTE huge *BlueBytes ; 

intj.k; 

Size = (DWORD)572-(DWORD)768*(DWORD)3 ; 

if ( SrcBmap != NULL ) bm_free(SrcBmap) ; 

SrcBmap = bm_ailoc(768,572,g!ModelColor); 

SrcBmap->gpic = (BYTE huge -)GlobalAllocPtr(GMEM_MO 

RedBytes = SrcBmap->gpic ; 

GreenBytes = SrcBmap->gpic+1 ; 

BlueBytes = SrcBmap->gpic+2 ; 

mfg_setgframe(R); 

for ( k = 0 ; k < 572 ;k++ ) { 

mfg_brhline(PAGEO,0,k,768,rpixarr) ; 

for ( j = 0 ; j < 768 ; j++ ) { 
*RedBytes = rpixarrQ] ; 
RedBytes += 3 ; 

} 

} 

mfg_setgframe(G); 
for ( k = 0 ; k < 572 ;k++ ) { 
mfg_brhiine(PAGE0,0,k,768,rpixarr) ; 
for ( j = 0 ; j < 768 ; j++ ) { 
"GreenBytes = rpixarrQ] ; 
GreenBytes += 3 ; 




nt() - Ticks) ; 

j.MBJCONEXCLAMATION | 



} 
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mfg_setgframe(B); 
for ( k = 0 ; k < 572 ;k++ ) { 
mfg_brhline(PAGE0,0,k,768,rpixarr) ; 
for ( j = 0 ; j < 768 ; j++ ) { 
•BlueBytes = rpixarrQ] ; 
BlueBytes += 3 ; 

} 

} //if ( InterpMode == IN_TRILINEAR ) 
// build_pyramid(hwnd,SrcBmap) ; 

teach_rgb_pallete(hwnd) ; 
FileType = FILE_IS_RGB ; 
GetClientRect(hwnd,&ClientRect) ; 
create_norm_bmap(hwnd,SrcBmap,&Normap,ClientRect); 

return 1 ; 



} 

int PASCAL load_picture_from_file(HWND hwnd.char -FileName) 
{ 

int ColorFactor ; 
int Width, Height ; 
DWORD SrcSize ; 
DWORD i ; 

if ( glModelColor == GREY_MODEL ) { 
ColorFactor = 1 ; - 

IpGreyRgb = ReadRGB (hwnd.FileName.&Width.&Height) ; 
IpPtr = IpGreyRgb ; 

if ( glModelColor = COLOR_MODEL ) { 
ColorFactor = 3 ; . 
IpPtr = ReadRGB (hwnd.FileName.&Width.&Heignt) ; 

> 

IsRgb = 1 ; 

bm free(SrcBmap) ; ._,„»■■* 
SrcBmap = bm_alloc(Width,Height, glModelColor); 
if (SrcBmap == NULL) { 

MessageBox (hwnd. szAppName,"bm_alloc 
Failed!", MBJCONEXCLAMATION | MB_OK) ; 

return 0 ; 

SrcSize = (DWORD)Width-(DWORD)(Height)-(DWORD)(ColorFactor); 
SrcBmap->gpic = IpPtr ; 

if ( SplitMode == 1 && SrcBmap != NULL) { _ 

split_bitmap(SrcBmap.SrcBmap->typ,30) ; // NEW CALL 



GetClientRect(hwnd,&ClientRect) ; 
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create.norm.bmapChwnd.SrcBmap.&Normap.ClientRect); 
return 1 ; 

} 

int PASCAL drawJield_to_screen(HWND hwnd , MYB ITMAP *Bmap,jnt 

IsOdd) 

{ 

int i,j ; 

BYTE huge *Ptr ; 
BYTE huge *PtrR ; 
BYTE huge *PtrG ; 
BYTE huge *PtrB ; 
int Cols.Rows; 

lsOdd = 1-lsOdd ;// PATCH 
. Cols - Bmap->cols ; 
Rows = (DWORD)(Bmap->rows)*(DW0RD)2 ; 

Ptr = Bmap->gpic ; 

//Ptr += (DWORD)lsOdd-(DWORD)Cols*(DWORD)3 ; 
PtrR = Ptr ; 
PtrG = Ptr+1 ; 
PtrB = Ptr+2 ; 
mfg_setgframe(R); 
for ( i = IsOdd ; i < Rows ; i +=2 ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

rpixarrQ] = *PtrR ; 

PtrR += 3 ; . 

//PtrR += (DWORD)Cols+(DWORD)3 ; 
mfg_bwhline(PAGEO,0,i 1 Cols,rpixarr); 

mfg_setgframe(G); 
for ( i = IsOdd ; i < Rows ; i +=2 ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

rpixarrD] = *PtrG ; 

PtrG += 3 ; 

//PtrG += (DW0RD)Cols+(DW0RD)3 ; 
mfg_bwhline(PAGEO,0,i,Cols,rpixarr) ; 

} 

mfg_setgframe(B); 
for ( i = IsOdd ; i < Rows ; i +=2 ) { 
for ( j = 0 ; j < Cols ; j++ ) { 

rpixarrD] = *PtrB ; 

PtrB += 3 ; 

//PtrB += (DWORD)Cols+(DWORD)3 ; 
mfg_bwhline(PAGEO I 0,i 1 Cols,rpixarr) ; 
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return 1 ; 
} 

int PASCAL get_fittness_of_vertexes(HWND hwnd.RECT Bound.MYBITMAP 
* BmaP ' RPOINT 'DstPnts, DWORD *Sum) 

MYBITMAP *BoundedBmap=NULL ; 
MYBITMAP *DiffBmap =NULL ; 
RPOINT SrcPnts[4]; 

|_cp_int_arr_to_RPOINT(SrcPnts, SignX, SignY,4) ; 

create_grey_bounded_bitmap(Bound,Normap,&BoundedBmap) ;//Copy the 

area t0 // be changed into a 

//separate bitmap. 

Derspectivefhwnd, Bmap, Normap, SrcPnts , 

DstPnts, GREYJvlODEL, &BasicTransf) ; 

// Perform perspective 
// grey of the current sign 
// with itself into NormBmap. 

substract_bitmaps(Bound.Normap,BoundedBmap,&DiffBmap) ; // Subtract 

BoundedBmap y, from the transformed 

// sign area in NormBmap. 

sum_grey_bitmap_value(DiffBmap,Sum) ; 

bm_free(BoundedBmap) ; 
bm_free(DiffBmap) ; 

return 1 ; 
} 

int PASCAL replace_sign(HWND hwnd,RPOINT *Dest) 
MYBITMAP *AlphaMap ; 

build alpha map(&AlphaMap, SrcBmap.Destj ; 

perspective a i(hwnd I SubstBmap,SrcBmap,AlphaMap SrcPoly. 

Dest, gIModelColor, &BasicTransf) ; 

bm free(AlphaMap) ; ■ ■ ~, D ^ 

create_norm_bmap(hwnd,SrcBmap.&Normap.GIBound); 

return 1 ; 

> 3P\\ 
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in, PASCAL smoom.veluesldouMe NewVal^b* , -OutVal.doubie 1«*r, 
int Num. double *Wheignt) 



{ 

int i ; 

double SumW = 0.0 ; 
double Calc ; 

for ( i = 0 ; i < Num-1 ; i++ ) { 
ValArr[i] = ValArr[i+1]; 

ValArr[Num-1] = NewVal ; 
Calc = 0 ; 

for ( i = 0 ; i < Num ; '(++){ 

Calc += ValArr[i]*Wheight[i] ; 
SumW += Wheight[i]; 

} 

"OutVal - Calc/SumW ; 

return 1 ; 

} 



int PASCAL create_subs_sign(HWND hwnd) 

//Perspective_Transform TpCurr ; 

Perspective_Transform BasicTransf ; 

RECT Rectan ; 

int Cols, Rows ; 

DWORD Size ; 

RPOINT SrcPnts[4] ; 

RPOINT CrnPoly[4] ; 



//Quad2Quad(hwnd,SrcPoly,DstPoly,&TpCurr); 



l_find_bound_rect(DstPoly. &Rectan) ; 
Cols = Rectan.right-Rectan.left+1 ; 

Rows = Rectan. bottom-Rectan.top+1 ; _ . . n . 

|_quad_in_new_origin(CrnPoly ; DstPoly,Re C tan.left,Rectan.top,4), 

nor<;nectivefhwnd SubstBmap.Subs.SrcPoly, 

perSpeCt,Ve( ' CrnPoly, COLOR.MODEL, &Bas.cTransf) ; 
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return 1 ; 

} 

int PASCAL fill_mask_rect(MYBITMAP 'Bmap) 
{ 

int ij.kj i 
int Cols, Rows ; 
int Count ; 
int Index = 0 ; 

Cols = Bmap->cols ; 
Rows = Bmap->rows ; 
Count = 0 ; 

for ( i= 0 ; i < Cols ; i++ ) { 

if ( BITMAP_PLACE(Bmap,0,i) == 0) Count++ , 

else { 

if ( Count > 0 ) { 

OcclusionRects[lndex].top = 0 ; 
OcclusionRects[lndex].left = i - Count+1 ; 
OcclusionRects[lndex].bottom = Rows ; 
OcclusionRects[lndex].right = i T+Count/3 */ ; // IF BUG i. 
Index++ ; 
Count = 0 ; 

} 

} 

if ( Index == 0 && NumOfVaiidOccRects > 0 ) { 
OcclusionRects[0]=ValidOccRects[0]; " 
OcclusionRects[0].right = min(OcdusionRects[0].nght+2,Cols-1) , 
OcclusionRects[0].bottom = Rows ; 

for ( k = OcclusionRects[0].top ; k < Occlus.onRects[0] bottom . k++ ){ 
for ( I = OcclusionRects[0].left ; l< OcclusionRects[0].nght ; I++ ) { 
BITMAP_PLACE(Bmap,k,l) = 0 ; 

} 

} 

Index = 1 ; 

NumOfOccRects = Index ; 

return 1 ; 
} 

int PASCAL ValidateOccRects(MYBITMAP *Bmap) 
{ 

int i, j,k,l ; 

RECT Intersection ; 
int Index = 0 ; 

3f)2> 
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for ( j = 0 • j < NumOfValidOccRects ; { 

if ( Intersection.bottom == 0 ) { • w++ > 

for ( k = OcclusionRects[i].top ; k < OcclusionRects[i].bottom , k++ ) 



{ 



for ( I = OcclusionRects[i].left ; l< OcclusionRects[i].right ;!++){ 
BITMAP_PLACE(Bmap,k,l) = 1 ; 

} 

} 



} 

} 

} 

return 1 ; 
} 

int PASCAL copy_into_valid_rects() 
{ 

int i ; 

for ( i = 0 ; i < NumOfOccRects ; i++ ) { 
ValidOccRects[i] = OcclusionRects[i] ; 

NumOfValidOccRects = NumOfOccRects ; 
return 1 ; 

} 

int PASCAL enlarge_area_bf_noise(MYBITMAP *From,MYBITMAP *Bmap) 
{ 

int i, j ; 

int Cols.Rows ; 
RECT Rectan ; 



Cois = Bmap->cols ; 
Rows = Bmap->rows ; 
for ( j = 4 ; j < Cols^t ; j+=3 ) { 
f or ( i = 4 ; i < Rows -4 ; i++ ) { 

Rectan.top = i-3 ; 

Rectan.left = j-3 ; 

Rectan.right = j+3 ; 

Rectan.bottom = i+3 ; . 
filter_noises_by_rects(From,Rectan,8,25,Bmap) , 

} 
} 

return 1 ; 

} 
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#include <windows.h> 
#include <windowsx.h> 
#include <commdlg.h> 
#include <stdlib.h> 
#include <math.h> 
#include "consth" 
#include "bitmap.h" 
#include "lines.h" 
#include "track.h" 
#include "min_mag.h" 
#include "lib.h" 

RECT Screen ; 

MYBITMAP FAR *dMaps[1 + DLVLS]; 
MYBITMAP FAR *iMaps[1 + 1LVLS]; 

" int PASCAL refine_alpha_edges(MYBITMAP* ) ; 
int PASCAL getJongest_occlusion(MYBITMAP *,int .int ) ; 

MYBITMAP FAR * bm_alloc(int xdim, int ydim, BMTYPE typ) 
{ 

MYBITMAP FAR* bm; 

bm = (MYBITMAP FAR *) 
GlobalAllocPtr(GMEM_MOVEABLE,sizeof(MYBITMAP)); 

if (bm == NULL ) 
return NULL ; 

bm->typ = typ; 
bm->cols = xdim; 
bm->rows = ydim; 
bm->gpic = NULL ; 

return (bm); 

> 
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double PASCAL bilinear(double xs, double ys. MYBITMAP FAR- bmap) 



{ 

int yi = (int) ys; 

double dy = ys- (double) yi; 

int xi = (int) xs; 

double dx = xs - (double) xi; 

double gOO, g01 , g1 0, g1 1 , g1 , g2; 



if (xi < 0 || xi >= bmap->cols) 

return (-1.0); 
if (yi < 0 || yi >= bmap->rows) 

return (-1.0); 
gOO = BfTMAP_PLACE(bmap,yi,xi) ; 

g 01 = (xi == bmap->cols - 1 ? gOO : BITMAP_PLACE(bmap,yi,xi+1 )); 
g10 = (yi == bmap->rows - 1 ? gOO : B!TMAP_PLACE(bmap.yi+1,xi)); 
g1 1 = (xi == bmap->cols - 1 || yi == bmap->rows - 1 ? 

gOO : BlTMAP_PLACE(bmap,yi+1,xi+1)); 
g1 =gOO+ (g01-gOO)*dx; 
g2 = g10 + (g11-g10)*dx; 

retum(g1 + (g2-gl)*dy) ; 

} 

double PASCAL bilinear_red(double xs, double ys, MYBITMAP FAR* bmap) 



{ 

int yi = (int)ys; 

double dy = ys - (double) yi; 

int xi = (int) xs; 

double dx = xs - (double) xi; 

double gOO, g01, g10, g11, g1, g2; 



if (xi < 0 || xi >= bmap->cols) 

return (-1 .0); 
if (yi < 0 || yi >= b.map->rows) 

return (-1 .0); 
gOO = B ITMAP_RGB_P LAC E(bmap,yi,xi) ; 
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g01 = (xi == bmap->cols - 1 ? gOO : 
-(BrrMAP_RGB_PLACE_PTR(bmap,yi,xi+1))); 

g i0 = (yi = bmap->rows - 1 ? gOO 
:-(BlTMAP_RGB_PLACE_PTR(bmap,yi+1,xi))); 

g1 -i = ( Xi == bmap->cols - 1 || yi == bmap->rows - 1 ? 

gOO : *(BrTMAP_RGB_PLACE_PTR(bmap,yi+1,xi+1))); 

g1 = gOO * (1 .0 - dx) + g01 * dx; 

g2 = g10*(1.O-dx) + gll *dx; 

return (g1 * (1.0 - dy) + g2 * dy); 



double PASCAL bilinear_green(double xs. double ys, MYBITMAP 



bmap) 
{ 

int yi = (int) ys; 

double dy = ys - (double) yi; 

int xi = (int) xs; 

double dx = xs - (double) xi; 

double gOO, g01 , g1 0, g1 1 , g1 . g2; 



if (xi < 0 H xi >= bmap->cols) 

return (-1 .0); 
if (yi < 0 H yi >= bmap->rows) 

return (-1 .0); 

gOO = *(BrTMAP_RGB_PLACE_PTR(bmap,yi,xi)+1) ; 
g01 = (xi == bmap->cols - 1 ? gOO : 

*( B ITMAP_RGB_P LAC E_PTR(bmap , y i ,xi+1 )+1 )); 

g10 = (yi == bmap->rows - 1 ? gOO : 

*(BITMAP_RGB_PLACE_PTR(bmap.yi+1 ,xi)+1 )); 

g1 1 = (xi = bmap->cols - 1 || yi == bmap->rows - 1 ? 

gOO : *(BITMAP_RGB_PLACE_PTR(bmap,yi+1,xi+1)+D); 
g1 = gOO * (1.0 - dx) + g01 * dx; 
g2 = g10 *(1.0- dx) + g11 *dx; 

return (g1 * (1.0 - dy) + g2 * dy); 

} 
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double PASCAL bilinear_biue(double xs. double ys, MYBITMAP FAR- bmap) 



{ 

int yi = (int) ys; 

double dy = ys - (double) yi; 

int xi = (int) xs; 

double dx = xs - (double) xi; 

double gOO, g01 , g1 0, g1 1 . g1 , g2; 



if (xi < 0 || xi >= bmap->cols) 

return (-1.0); 
if (yi < 0 || yi >= bmap->rows) 

return (-1.0); 

gOO = *(BITMAP_RGB_PLACE_PTR(brnap,yi,xi)+2) ; 

g01 = (xi == bmap->cols - 1 ? gOO 
:*(BITMAP_RGB_PLACE_PTR(bmap,yi,xi+1)+2)); 

g1 0 = (yi == bmap->rows - 1 ? gOO 
:*(BITMAP_RGB_PLACE_PTR(bmap,yi+1,xi)+2)); 

g1 1 = (xi == bmap->cols - 1 || yi == bmap->rows - 1 ? 

gOO : *(BITMAP_RGB_PLACE_PTR(bmap,yi+1 ,xi+1 )+2)); 

g1 = gOO * (1 .0 - dx) + g01 * dx; 

g2 = g10 * (1.0 - dx) + g1 1 " dx; 

return (g1 * (1 .0 - dy) + g2 * dy); 

} 

int PASCAL multmat(HWND hwnd.int Ma, int Na, int Nb, double -A, doubl 

*B, double *C) 

{ 

int i, j, k; 

for (i = 0; i < Ma; i++) { 
for (j = 0; j < Nb; { 

C[(DWORD)i • (DWORD)Nb + (DWORD)j] = 0.0; 
for (k = 0; k < Na; k++) { 

C[(DWORD)i * (DWORD)Nb + (DWORD)]] += 
A[(DWORD)i - (DWORD)Na + (DWORD)k] * 

B[(DWORD)k * (DWORD)Nb + (DWORD )j]; 

> 
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} 

} 

return 1 ; 

> 

double PASCAL resample_trilinear(MYB!TMAP FAR* bmap, double xs, 
double ys, 

.double D.int ColorModel) 

{ 

int id.i.mag ; 

double fMag.hMag; 
double g1,g2,alpha,g ; 



if (D <= 1 .0) // magnified pyramid level not used 

return (bilinear(xs, ys, bmap)); 
id = (int) ceil(D); 
for (i = 1;i<= DLVLS; j++) { 

mag = (1 « i); 

if (mag >= id) 
break; 

} 

if (i > DLVLS) // interplation is bi-linear 

return (bilinear(xs, ys, dMaps[ILVLS])); 



fMag = mag; 
hMag = mag / 2; 

g1 = biiinear(xs / hMag, ys / hMag, dMapsp - 1]); 
g2 = bilinear(xs / fMag, ys / fMag, dMapsp]); 
alpha = (D - hMag) / hMag; 
g = g1 * (1 .0 - alpha) + g2 * alpha; 



return (g); 

} 

double PASCAL re sample_trilinear_red(MYBITMAP FAR* bmap, double xs. 
double ys, 

QPf\ 
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double D.int ColorModel) 

{ 

int id.i.mag ; 

double fMag.hMag ; 

double g1,g2,alpha,g ; 

if (D <= 1-0) // magnified pyramid level not used 

return (biiinear_red(xs, ys, bmap)); 
id = (int) ceil(D); 
for (i = 1; i <= DLVLS; i++) { 

mag = (1 « i); 

if (mag >= id) 
break; 

} 

if (i > DLVLS) // interplation is bi-Iinear 

return (bilinear_red(xs, ys, dMaps[lLVLS])); 

fMag = mag; 
hMag = mag / 2; 

g1 = biiinear_red(xs / hMag, ys / hMag, dMaps[i - 1]); 
g2 = bilinear_red(xs / fMag, ys / fMag, dMapsp]); 
alpha = (D - hMag) / hMag; 
g ■ g1 • (1 .0 - alpha) + g2 * alpha; 

return (g); 

} 

double PASCAL resample_trilinear_green(MYBITMAP FAR* bmap, double 
xs, double ys, 

double D.int ColorModel) 

{ 

int id.i.mag ; 

double fMag.hMag; 
double g1,g2,alpha,g ; 

if (D <= 1 .0) // magnified pyramid level not used 
Boo 
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return (bilinear_green(xs, ys, bmap)); 
id = (int) ceil(D); 
for (i = 1; i<= DLVLS; i++){ 

mag = (1 « i); 

if (mag >= id) 
break; 

if (i > DLVLS) // interplation is bi-linear 

return (bilinear_green(xs, ys, dMaps[ILVLS])); 



fMag = mag; 
hMag = mag/2; 

g1 = bilinear _green(xs / hMag. ys / hMag, dMaps[i - 1]); 
g2 = bilinear_green(xs / fMag, ys / fMag, dMaps[i]); 
alpha = (D - hMag) / hMag; 
g = g1 * (1.0 - alpha) + g2 * alpha; 

return (g); 

double PASCAL re sam P le_trilinear_blue ( MYBrTMAP FAR* bmap, double xs, 
double ys, 

double D.int ColorModel) 

{ 

int id.i.mag ; 

double fMag.hMag ; 

double g1,g2,alpha,g; 

if (D <= 1 .0) // magnified pyramid level not used 

return (bilinear_blue(xs, ys, bmap)); 
id = (int) ceil(D); 
for (i = 1; i <= DLVLS; i++) { 

mag = (1«0; 

if (mag >= id) 
break; 

} 

3oi 
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if (i > DLVLS) // interplation is bi-linear 

return (bilinear_blue(xs, ys, dMaps[ILVLS])); 

fMag = mag; 
hMag = mag / 2; 

g1 = bilinear_blue(xs / hMag, ys / hMag, dMaps[i - 1]); 
g2 = bilinear_blue(xs / fMag, ys / fMag, dMapsfil); 
alpha = (D - hMag) / hMag; 
g = g1 * (1 .0 - alpha) + g2 * alpha; 

return (g); 

} 



int PASCAL build _pyramid(HWND hwnd. MYBITMAP FAR * SrcBmap) 
{ 

int i ; 

dMapsJO] = iMaps[0] = SrcBmap; 
for (i = 1 ; i <= DLVLS; { 

dMaps[i] = minify(hwnd, dMaps[i - 1], 2); 

} 

return 1 ; 

} 

int PASCAL bm_free(MYBITMAP FAR* BtMap) 
{ 

if ( BtMap != NULL){ 

GlobalFreePtr(BtMap->gpic) ; 
GlobalFreePtr(BtMap) ; 

} 

return 1 ; 

} 

int PASCAL f,nd_horizJine(MYBITMAP *Bmap,POINT Pointl , POINT 

RPOINT "Line) 

{ 

30a 
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int ij.Ri.Rj ; 

double Luma1[7][7] ; 

double Luma2[7][7] ; 

double r,g,b ; 

double Tresh = 70 ; 

RPOINT Found1,Found2 ; 

int Found ; 

for ( i = Pointl .y-3, Ri = 0 ; Ri < 7 ; i++,Ri++) { 
for ( j = Pointl .x-3, Rj = 0 ; Rj < 7 ; j++,Rj++ ) { 

r = *( B ITM AP_RG B_P LAC E_PTR( B map , i , j)) ; 
g = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j)+1) ; 
b = *(BITMAP_RGB_PLACE_PTR(Bmap,ij)+2) ; 
Lumal [Ri][Rj] = r • 0.299 + g * 0.587 + b * 0.1 14; 

} 

} 

for ( i = Point2.y-3, Ri = 0 ; Ri < 7 ; i++,Ri++) { 
for ( j = Point2.x-3, Rj = 0 ; Rj < 7 ; j++.Rj++ ) { 

r = "(BITMAP_RGB_PLACE_PTR(Bmap,i,j)) ; 
g = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j)+1J ; 
b = -(BITMAP_RGB_PLACE_PTR(Bmap,ij)+2) ; 
Luma2[Ri][Rj] = r - 0.299 + g * 0.587 + b * 0.1 14; 

} 

} 

Found = 0 ; 
Found1.x= Pointl .x ; 
Found1.y= Pointl .y ; 
for ( i = 1 ; i < 6 && Found == 0; i++ ) { 
for ( j = 0 ; j < 6 ; j++ ) { 

if ( fabs(Luma1[i-1][j]-Luma1[i][j]) >= Tresh ) { 

if ( fabs(Luma1[i-1]D+H - Lumal [i]D+1]) >= Tresh || 
fabs(Luma1[i+1]D + 1] - Lumal [i][j+1]) >= Tresh ) { 
Found1.x= Pointl .x-3+j; 
. Foundl.y = Poind .y -3+i ; 
Found = 1 ; 
break ; 

} 

} 
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} 

} 

Found = 0 ; 
FoundZx = Point2.x ; 
Found2.y= Point2.y ; 
for ( i = 1 ; i < 6 && Found == 0 ; i++ ) { 
f or ( j = 0 ; j < 6 ; j++ ) { 

if ( fabs(Luma2[i-1]0]-Luma2[i]D]) >- Tresh ) { 

if ( fabs(Luma2[i-1]D+1] - Luma2[i]D+1 ]) >= Tresh || 
fabs(Luma2[i+1]D+1] - Luma2[i]D+1]) >= Tresh ) { 
Found2.x = Point2.x -3+j ; 
Found2.y = Point2.y -3+i ; 
Found = 1 ; 
break ; 

} 

} 

} 

} 

y ne _> y = (Found2.x*Found1 .y-Found2.y*Found1 .x)/(Found2.x-Found1 jc) ; 
Line->x = (Foundl .y-Line->y)/Found1 jc ; 

return 1 ; 
} 

int PASCAL find_vertic_line(MYBITMAP *Bmap,POINT PoinH, POINT 

Point2, RPOINT *Line) 

{ 

int ij.Ri.Rj ; 

double LumairTit 7 ] : 

double Luma2[7][7] ; 

double r,g,b ; 

double Tresh = 70 ; 

RPOINT Foundl ,Found2 ; 

int Found ; 

for ( i = Pointl .y-3. Ri = 0 ; Ri < 7 ; i++.Ri++) { 
for ( j = Pointl .x-3, Rj = 0 ; Rj < 7 ; j++,Rj++ ) { 
3om 
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r = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j)) ; 
g = -(BITMAP_RGB_PLACE_PTR(Bmap,ij)+1) ; 
b = -(BITMAP_RGB_PLACE_PTR(Bmap,i.j)+2) ; 
Lumal [Ri][Rj] = r - 0.299 + g - 0.587 + b * 0.1 14; 

} 

Lr ( i = Point2.y-3, Ri = 0 ; Ri < 7 ; i++,Ri++) { 
for ( j = Point2.x-3, Rj = 0 ; Rj < 7 ; j++,Rj++ ) { 
r = -(BITMAP_RGB_PLACE_PTR(Bmap,i j)) ; 
g = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j)+1) ; 
b = -(BITMAP RGB_P LAC E_PTR( Bmap, i,j)+2) ; 
Luma2[RiKRj] = r * 0.299 + g * 0.587 + b * 0.1 14; 

} 

} 

Found = 0 ; 
Found1.x= Pointl.x; 
Foundi.y = Pointl.y; 
for ( i = 0 ; i < 6 && Found == 0; i++ ) { 
for(j = 0;j<6 ;j++){ 

if ( fabs(Luma1[i]Dl-Luma1 >= Tresh > i . 

if ( fabs(Luma1[i+1][j] - Lumal [i+1]D+1]) >= Tresh ) { 
Found1.x = Pointl.x -3+j ; 
Foundl .y = Pointl .y -3+i ; 
Found = 1 ; 
break ; 

} 

} 

} 

} 

Found = 0 ; 
FoundZx = PointZx ; 
FoundZy = Point2.y ; 
for ( i = 0 ; i < 6 && Found == 0 ; i++ ) { 
for(j = 0;j<6 ;]++){ 

if ( fabs(Luma2[i}D]-Luma2[i]D-1]) >= Tresh ) { 

if ( fabs(Luma2[i+1][j] - Luma2[i+1][j+1l) >= Tresh ) < 
FoundZx = Point2.x -3+j ; 
Found2.y = Point2.y -3+i ; 
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Found = 1 ; 
break ; 

} 

} 

} 

} 

if ( Found2.x == Foundl .x ) { 

Line->y = 0.0 ; 

Line->x= Found 1.x; 
} else { 

Line->y = (Found2.x*Found1 .y-Found2.y*Found1 .x)/(Found2.x-Found1 .x) ; 
Lj ne _>x = (Foundl .y-Line->y)/Found1 .x ; 

} 

return 1 ; 
} 

#define HSx 5 r Half search area (x) */ 
#define HSy 5/" Half search area (y) •/ 
#define HWx 4 r Half correlation window (x) */ 
#define HWy 4 r Half correlation window (y) 7 

int PASCAL create Jum_bmap(MYBITMAP *Bmap, MYBITMAP **LumBmap) 
{ 

BYTE huge * Tmp; 
BYTE huge * TmpB ; 
int Cols, Rows ; 
DWORD Size , 
DWORD i ; 

Cols = Bmap->cols ; 
Rows = Bmap->rows ; 

Tmp = Bmap->gpic ; 
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bm_free(*LumBmap) ; 

-LumBmap = bm.allocfCols.Rows.GREYJVIODEL); 
Size = (DWORD)Cols"(DWORD)Rows ; 

r LumBmap)->gpic = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) 

TmpB = (*LumBmap)->gpic ; 
Tmp = Bmap->gpic ; 

for ( i = 0 ; i < Size ; i++ ) { 

-(TmpB++) = (BYTE)((double)(*(Tmp++))* 0.299 + 

(doubler(Tmp++r 0.587 + (double)-(Tmp^r 0.114); 

} 

return 1 ; 
} 

int PASCAL duplicate J>map(MYBrTMAP -FrBmap, MYBITMAP ~ToBmap,int 

Type) 

{ 

BYTE huge * Tmp; 
BYTE huge * TmpB ; 
int Cols, Rows ; 
DWORD Size ; 
DWORD i ; 
int ColorFactor=1 ; 

Cols = FrBmap->cols ; 
Rows = FrBmap->rows ; 

if ( Type == COLOR_MODEL ) ColorFactor = 3 ; 
Tmp = FrBmap->gpic ; 
if ( *ToBmap != NULL ) bm_free(ToBmap) ; 
ToBmap = bm_alloc(Cols,Rows,Type); 

Size.= (DWORD)Cols*(DWORD)Rows*(DWORD)ColorFactor ; 
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(-ToBmap)->gpic = (BYTE huge")GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 

TmpB = (T oBmap)->gpic ; 
Tmp = FrBmap->gpic ; 

for ( i = 0 ; i < Size ;i++ ) { 

*(TmpB++) = *(Tmp++) ; 

} 

return 1 ; 
} 

int PASCAL create_grey_bounded_bitmap(RECT area, MYBITMAP 

"Bmap, MYB ITMAP ~BoundBmap) 

{ 

int i, j ; 

int Cols, Rows ; 
DWORD Size ; 
BYTE huge" Tmp ; 

Cols = area.right - area.left ; 
Rows = area. bottom - area,top ; 
bm_free(*BoundBmap) ; 

•BoundBmap = bm_alioc(Cols, Rows, GREY_MO DEL) ; 
Size = (DWORD)Cols*(DWORD)Rows ; 
(*BoundBmap)->gpic = (BYTE 
huge*)GlobalAliocPtr(GMEM_MOVEABLE,Size) ; 

Tmp = (*BoundBmap)->gpic ; 
for ( i = area.top ; i < area.bottom ; i++ ) { 
for ( j = area.left ; j < area.right ; j++ ) { 

*(j mp ++) = BITMAP_PLACE(Bmap,i,j) ; 

} 

} 

return 1 ; 
} 

30? 
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int 

•Subs, 



PASCAL substract_bitmaps(RECT area , M YB ITMAP *F rom , M YB ITMAP 
MYBITMAP "Diff) 



{ 

DWORD Size ; 
int Cols, Rows ; 
int i, j ; 

BYTE huge*Tmp ; 

Cols = Subs->cols ; 
Rows = Subs->rows ; 
bm_free(*Diff) ; 

•Diff = bm_alloc(Cols,Rows,GREY_MODEL) ; 
Size = (DWORD)Cols«(DWORD)Rows ; 

(*Diff)->9Pic = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 
Tmp = (*Diff)->gpic ; 

for ( i = area.top ; i < area, bottom ; i++ ) { 
for ( j = area. left ; j < area.right ; j++ ) { 

*(Tmp++) = (BYTE)abs((int)(BITMAP_PLACE(From,i,j)- 
BITMAP_PLACE(Subs,i-area.top,j-area.left))) ; 

} 

} 

return 1 ; 
> 

int PASCAL insert_grey_bounded_bitmap(RECT area.MYB ITMAP Tolnsert, 

MYBITMAP *lnto) 

{ 

int i, j ; 

for ( i = area.top ; i< area.bottom ; i++ ) { 
for ( j = area. left ; j< area.right ; j++ ) { 
B ITM AP_P LAC E( I nto, i ,j) = 

BITMAP_PLACE(Tolnsert,i-area.top,j-area.left) ; 

} 

} 3lY\ 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/01679 



return 1 ; 
} 

int PASCAL copy_grey_rect_from_frame(MYBITMAP Into, MYBtTMAP 
*From, 

RECT area) 

{ 

int i,j ; 

for ( i = area.top ; i < area.bottom ; i++ ) { 
for ( j = area.left ; j < area.right ; j++ ) { 

B™AP_PLACE(lnto,i-area.top,j-area.left) = BITMAP_PLACE(From,«j) 

} 

} 



return 1 ; 
} 

int PASCAL buiid_a!pha_map(MYBITMAP ~AiphaMap, MYBITMAP 

*SrcBmap.RPOINT *Vertex) 

{ 

int i,j ; 

RECT Rectan ; 
int Cols, Rows ; 
SEG lines[4] ; 
DWORD Size ; 
RPOINT Points[4] ; 
double Xval.Xmin.Xmax ; 
int Curr ; 



Cols = SrcBmap->cols ; 
Rows = SrcBmap->rows ; 
l_find_bound_rect(Vertex, &Rectan) ; 
for ( i = 0 ; i < 3 ; i++ ) { 
mksegment(Vertex[i].x. Vertex[i].y. Vertex[i + 1].x, Vertex[i + 1].y,&(lines[.])) ; 

} 
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mksegment(Vertex[3].x. Vertex[3].y, Vertex[0].x, Vertex[0].y,&(lines[3])) ; 
•AlphaMap = bm_alloc(Cols,Rows,GREY_MODEL); 
Size = (DWORD)Cols*(DWORD)Rows ; 
(-AlphaMap)->gpic = 

(BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE | 

GMEM_ZEROINIT,Size) ; 
fof( i = Rectan.top ; i < Rectan. bottom ; i++ ) { 
Curr = 0 ; 

for(j = 0;j<4;j++) { 
if ( Iines0].a !=0.0 ){ 

Xval = -1 .0 *(linesQ].b*(double)i + iines[j].c)/linesD].a ; 
if ( Xval <= Cols && Xval >= 0 ) { 
if ( i <= (int)(linesD].ymax) && i >= (int)(lines[j].ymin) ) 
Points[Cun-n-].x = Xval ; 

} 

} 

} 

Xmin = Points[0].x ; 

Xmax = Xmin ; 

for ( j = 1 ; j < Curr ; j++ ) { 

Xmin = min(Points[j].x,Xmin) ; 

Xmax = max(Points[j].x,Xmax) ; 

} 

for ( j = (int)Xmin ; j <= (int)Xmax ; j++ ) { 
BITMAP_PLACE((*AlphaMap),i,j) = 1 ; 

} 

} 

refine_alpha_edges(*AlphaMap) ; 
return 1 ; 
} 

int PASCAL split_bitmap(MYBrTMAP -Bmap.int ColorModel.int FromRow) 
{ 

DWORD i,k ; 
int Cols, Rows ; 
DWORD Place ; 
BYTE huge *Dup ; 

int ColorFactor ; . : 
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DWORD Offset, Size, 0ffset2 ; 

ColorFactor = 3 ; 
Cols = Bmap->cols ; 
Rows - Bmap->rows ; 

Size = (DWORD)Rows*(DWORD)Cols-(DWORD)ColorFactor ; 
Rows = (Bmap->rows-FromRow) 11 ; 
if ( ColorModel == GREY_MODEL ) ColorFactor = 1; 
Offset = (DWORD)FromRow"(DWORD)Cols*(DWORD)ColorFactor ; 
Place = (DWORD)Rows-(DWORD)CoIs-(DWORD)ColorFactor ; 
Dup = Bmap->gpic + Size - Offser(DW0RD)2 ; 
Offset2 = 0ffser(DW0RD)2 ; 
' for ( i = 0 ; i < Offset2 ; i++ ) { 

*(Dup++) - *(Bmap->gpic +Place+i) ; 

} 

Dup = Bmap->gpic+Place ; 
k = 0 ; 

for ( i = Offset ; i < Place ; i++ ) { 
"(Dup+ k++) = *(Bmap->gpic +i) ; 

Size = (DWORD)Cols*(DWORD)6*(DWORD)ColorFactor ; // 6 Rows of 
Black. 

for ( i = 0 ; i < Size ; i++ ) { 
*(Dup++) = 0 ; 

} 

return 1 ; 
} 

int PASCAL refine_alpha_edges(MYBITMAP*AlphaMap) 
{ 

int i,j; 

int Cols, Rows ; 
BYTE Far, Close ; 
int Count = 0 ; 

Cols = AlphaMap->cols ; 
Rows = AlphaMap->rows ; 
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Far =170 ; 
Close = 85; 

for ( i = 2 ; i < Rows ; i++ ) { 
f or ( j = 2 ; j < Cols-1 ;j++){ 

if ( BITMAP_PLACE(AlphaMap,i,j) == 1 ) { 

r 

if ( BITMAP_PLACE(AlphaMap,i,j-1) == 0 ) { 
B 1TMAP_P LAC E(AlphaMap, i ,j-2) = Far ; 
BITMAP_PLACE(AlphaMap,i,j-1) = Close ; 

if ( BITMAP_PLACE(AlphaMap,i,j+1) == 0 ) { 
B ITMAP_PLAC E( AlphaMap, i j+2) = Far ; 
BITMAP_PLACE(AlphaMap,i,j+1) = Close ; 

} 
•/ 

if ( BITMAP_PLACE(AlphaMap,i-1 j) == 0 ) { 
B ITMAP_P LAC E(AI phaMap.i j) = Far ; 
BITMAP_PLACE(AlphaMap,i+1,j) = Close ; 

if ( BITMAP_PLACE(AlphaMap,i+1.j) == 0 ) { 
B ITM AP_P LAC E ( Al phaMap , i , j) = Far ; 
BITMAP_PLACE(AlphaMap,i-1,j) = Close ; 

} 

} 

} 

} 

r 

for ( i = 2 ; i < Rows ; i++) { 
for ( j = 2 ; j < Cols ; j++ ) { 

if ( BrTMAP_PLACE(AlphaMap,i,j) > 2 && 
BITMAP_PLACE(AlphaMap,iJ-1) ==0 ){ 
Array[Count].x = j-1 ; 
Array[Count++].y = i ; 

} 

} 

} 
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for ( i = 0 ; i < C-ount-1 ; i++ ) { 
Len = Array[i].x-Array[i+1].x ; 
if ( Len == 0 ) continue ; 
Unit = 256/Len ; 
Line = Array[i].y ; 

for ( j = Array[i3.x, k = 1 ; Len > 0 ; Len- ) { 

BITMAP_PLACE(AlphaMap,Line,j) = (DWORD)Unit*(DWORD)k ; 

j-: 
k++; 

} 

} 

*/ 

return 1 ; 
} 

r 

int PASCAL get_mask_bitmap(HWND hwnd,MYBITMAP -Bmap.int 

Tresh.MYBlTMAP -MaskBmap) 

{ 

int Cols, Rows ; 
BYTE huge Imp ; 
BYTE huge *BmapPtr ; 
DWORD Size ,indx ; 
int i.j.k ; 

int Limit, CounLValue ; 
MYBITMAP *ToBmap ; 

Cols = Bmap->cols ; 
Rows = Bmap->rows ; 
bm_free(*MaskBmap) ; 

-MaskBmap = bm_alloc(Cols,Rows,GREY_MODEL) ; 
Size = (DWORD)Cols*(DWORD)Rows ; 
(-MaskBmap)->gpic = (BYTE 
huge*)GlobalA!locPtr(GMEM_MOVEABLE,Size) ; 

Tmp = ("MaskBmap)->gpic ; 

BmapPtr = Bmap->gpic ; 

for ( indx = 0 ; indx < Size ; indx++ ) { 
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if ( •(BmapPtr++) <= Tresh ) { 

*(Tmp++) = 1 ; 
} else { 

*(Tmp++) = 0 ; 

} 

} 

duplicate bmap(*MaskBmap. &ToBmap,GREY_MODEL) ; 
enlarge_area_of_noise(ToBmap,*MaskBmap) ; 
WriteGreyRgb (hwnd/ , masku.rgb , \-MaskBmap) ; 
bm_free(ToBmap) ; 

Limit = Rows/3 ; 

for ( j = 0 ; j < Cols ; j++ ) { // 0 Means Occlusion. 1 Means 
Count = g etJongest_occlusion(*MaskBmap,j ( Rows) ; 
if ( Count < Limit ) { 
Value = 1 ; // 
//for ( i = 0 ; i < Rows ; i++ ) { 
// BITMAP_Pl_ACE((*MaskBmap),i,j) = 1 ; 

//} 

} else Value = 0 ; // 

for ( i = 0 ; i < Rows ; i++ ) { 11 

BITMAP_PLACE((*MaskBmap),ij) = Value ; // 



Count = 0 ; 

for ( j = 0 ; j < Cols ; j++ ) { 

if ( BITMAP_PLACE((*MaskBmap),0,j) == 0 ) Count++ ; 

else{ 

if ( Count == 0 ) continue ; 
if ( Count < 6 ) { 
for ( k = j-Count ; Count > 0 ; Count-. k++ ) { 
for ( i = 0 ; i < Rows ; i++ ) { 

BITMAP_PLACE((*MaskBmap),i.k) = 1 ; 

} 

} 

} else { // Count >= 6 

3i5 
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for ( i'= 0 ; i < Rows ; i++ ) { 

if ( j > (Count+12) ) Limit =j-(Count+12) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+1 1 ) ) Limit = j-(Count+1 1 ) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+1 0) ) Limit =j-(Count+10) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i,Limit) = 0 ; 
if ( j > (Count+9) ) Limit = j-(Count+9) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i,Limit) = 0 ; 
if ( j > (Count+8) ) Limit = j-(Count+8) ; 
else Limit = 0 ; 

BITMAP_PLACE((~MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+7) ) Limit = j-(Count+7) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+6) ) Limit = j-{Count+6) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+5) ) Limit = j-(Count+5) ; 
else Limit = 0 ; 

BITMAP_PLACE(("MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+4) ) Limit = j-(Count+4) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+3) ) Limit = j-(Count+3) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+2) ) Limit = j-(Count+2) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
if ( j > (Count+1 ) ) Limit = j-(Count+1) ; 
else Limit = 0 ; 

BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
3ifc 



SUBSTITUTE SHEET (RULE 



WO 95/10919 



PCT/US94/01679 



BfTMAP_PLACE{CMaskBmap),i,j-Count) = 0; 
BITMAP_PLACE(("MaskBmap),i,j) = 0 ; 
Limit = min(j+1,Cols-1) ; 
BUM AP_PLACE((*MaskBmap), i, Limit) = 0 ; 
Limit = minG+2,Cols-1) ; 
BfTMAP_PLACE((*MaskBmap),i,Limit) = 0 ; 
Limit = min(j+3,Cols-1) ; 
Bn"MAP_PLACE((*MaskBmap),i, Limit) = 0; 
Limit = rnin(j+4,Cols-1) ; 
BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
Limit = min(j+5,Cols-1) ; 
BITMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 
Limit = min(j+6,Cols-1) ; 
BrrMAP_PLACE(("MaskBmap),i,Limit) = 0 ; 
Limit = min(j+7,Cols-1) ; 
BrTMAP_PLACE((*MaskBmap),i,Limit) = 0 ; 
Limit = min(j+8,Cois-1) ; 
BrTMAP_PLACE((*MaskBmap),i, Limit) = 0 ; 

} 

j = minO+6,Cols-1) ; 
Count = 0 ; 



} 

} 

} 

return 1 ; 

} 
-/ 



int PASCAL get_mask_bitmap(HWND hwnd.MYBITMAP *Bmap,int 

Tresh.MYBITMAP -MaskBmap) 

{ 

int Cols, Rows ; 
BYTE huge *Tmp ; 
BYTE huge *BmapPtr ; 
DWORD Size Jndx ; 
int i.j.k ; 

int Limit.Count, Value ; 
MYBITMAP T empBmap ; 

3/1 
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RECT Rectan ; 

Cols = Bmap->coIs ; 
Rows = Bmap->rows ; 

TempBmap = bm_alloc(Cols,Rows,GREY_MODEL) ; 
Size = (DWORD)Cois*(DWORD)Rows ; 

TempBmap->gpic = (BYTE huge*)GlobalAIIocPtr(GMEM_MOVEABLE,Size) ; 
Tmp - TempBmap->gpic ; 
BmapPtr = Bmap->gpic ; 
for ( indx = 0 ; indx < Size ; indx++ ) { 
if ( *(BmapPtr++) <= Tresh ) { 

•(Tmp++) = 1 ; 
}else{ 

*{Tmp++) = 0 ; 

} 

} 

Limit = Rows/3 ; 

for ( j = 0 ; j < Cols ; j++ ) { I/O Means Occlusion. .1 Means OK. 
Count = get_longest_occlusion(TempBmap,j,Rows) ; 
if ( Count >= Limit ) { 

BrTMAP_PLACE(TempBmap,Oj) = 0 ; 
} else { 

BrTMAP_PLACE(TempBmap,Oj) = 1 ; 

} 



Count = 0 ; 

for ( j = 0 ; j < Cols ; j++ ) { 
if ( BrrMAP_PLACE(TempBmap,0,j) == 0 ) Count-n- ; 
else { 

if ( Count == 0 ) continue ; 
if ( Count < 6 ) { 
for ( k = j-Count ; Count > 0 ; Count-, k++ ) { 
for ( i = 0 ; i < Rows ; i++ ) { 

BrTMAP_PLACE(TempBmap,i,k) = 1 ; 
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} 

} else { // Count >= 6 

for ( k = j-Count ; Count > 0 ; Count-, k++ ) { 
for ( i = 0 ; i < Rows ; i++ ) { 

BITMAP_PLACE(TempBmap,i,k) = 0 ; 

} 

} 

for ( i = 0 ; i < Rows ; i++ ) { 

if ( j > (Count+5) ) Limit ='j-(Count+5) ; 
else Limit = 0 ; 

B ITMAP_P LAC EfTempBmap, i, Limit) = 0 ; 
if ( j > (Count+4) ) Limit = j-(Count+4) ; 
else Limit = 0 ; 

BITMAP_PLAC EfTempBmap, i, Limit) = 0 ; 
if ( j > (Count+3) ) Limit = j-(Count+3) ; 
else Limit = 0 ; 

BITMAP_PLACE(TempBmap,i, Limit) = 0 ; 
if ( j > (Count+2) ) Limit = j-(Count+2) ; 
else Limit = 0 ; 

BITMAP_PLACE(TempBmap,i,Limit) = 0 ; 
if ( j > (Count+1) ) Limit = j-(Count+1) ; 
else Limit = 0 ; 

B ITMAP_PLAC E(TempBmap, i, Limit) = 0 ; 
Limit = min(j+1.Cols-1) ; 
B ITMAP_PLAC E(TempBmap, i , Limit) = 0 ; 
Limit = min(j+2,Cois-1) ; 
BrTMAP_PLACECTempBmap,i,Limit) = 0 ; 
Limit = min(j+3,Cols-1) ; 
BITMAP_PLACE(TempBmap,i, Limit) = 0; 
Limit = min(j+4,Cols-1) ; 
B ITMAP_PLAC E(TempBmap, i, Limit) = 0; 
Limit = min(j+5,Cols-1) ; 
BITMAP_PIACE(TempBmap,i, Limit) = 0; 
j = min(j+5,Cols-1) ; 

} 

} 

Count = 0 ; 

} 

3l c l 
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} 

duplicate_bmap(TempBmap, MaskBmap,GREY_MODEL) ; 
/AA/riteGreyRgb (hwnd,"mask0.rgb",*MaskBmap) ; 
for ( i = 5 ; i < Rows-5 ; i++ ) { 
for (j = 5; j< Cols-5;j++){ 

if ( BITMAP_PLACE(TempBmap,ij) == 0 ) { 
Rectan.top = i-5 ; 
^ Rectan.left = j ; 

Rectan. bottom = i+5 ; 
Rectan. right =j+5 ; 

filter_noises_by_rects(TempBmap, Rectan l 6,30,"MaskBmap) ; 
Rectan.left = j-5 ; 
Rectan. right =j ; 

filter_noises_by_rects(T empBmap,Rectan,6,30 : "MaskBmap) ; 
Rectan. right =j+5 ; 

filter_noises_by_rects(TempBmap f Rectan, 11, £5 : *MaskBmap) ; 

} 

} 

} 

bm_free(TempBmap) ; 

/AA/riteGreyRgb (hwnd,"mask1.rgb",*MaskBmap) ; 
//Limit = Rows/4 ; 

for ( j = 1 ; j < Cois-2 ; j++ ) { I/O Means Occlusion. 1 Means OK. 
//Count = get_longest_occlusion(*MaskBmap,j,Rows) ; 
if ( BUMAP_PLACE((*MaskBmap),0 ( j-1) == 1 && 

(BITMAP_PLACE((*MaskBmap),0,j+2)== 1 || 
BITMAP_PLACE((*MaskBmap),0,j+1) == 1) } { 
for ( i = 0 ; i < Rows ; i++ ) { 

BrTMAP_Pl_ACE((*MaskBmap),i,j) = 1 ; 

} 

} 

} 

//WriteGreyRgb vhwnd,"mask2.rgb",*MaskBmap) ; 
return 1 ; 

} 

int PASCAL get longest occiusion(MYBITMAP "Bmap.in: coi.int rows) 
~ ~ 32. o 
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{ 

irit i ; 

int Count = 0 ; 
int Longest = 0 ; 

for ( i = 0 ; i < rows ; i++ ) { 

if ( BrrMAP_PI_ACE(Bmap,i,col) = 0 ) Count++ ; 
else { 

ff ( Count > Longest ) { 
Longest = Count ; 
Count = 0 ; 

} 

} 

} 

if ( Count > Longest ) { 
Longest = Count ; 

} 

return Longest ; 



double PASCAL bilinear_rgb(double xs, double ys, MYBFTMAP FAR* bmap, 



double *Ptr) 

{ 

int yi = (int) ys; 

double dy = ys - (double) yi; 

int xi = (int) xs; 

double dx = xs - (double) xi; 

double gOO, g01, g10, g11, g1, g2; 

BYTE huge *PtrX1 ; 

BYTE huge *PtrY1 ; 

BYTE huge *PtrX1Y1 ; 

BYTE huge *PtrXY ; 



PtrXY = BITMAP_RGB_PLACE_PTR(bmap,yi,xi) ; 
PtrX1 = BITMAP_RGB_PLACE_PTR(bmap,yi,xi+1) ; 
PtrY1 = BITMAP_RGB_PLACE_PTR(bmap,yi+1 I xi) ; 
PtrX1Y1 = BITMAP_RGB_PLACE_PTR(bmap,yi+1,xi+1) ; 
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g00 = PtrXY[0] ; 

g01 = (xi == bmap->cols - 1 ? gOO : PtrXl[0]); 
g10 = (yi == bmap->rows - 1 ? gOO : PtrY1[0]); 

g1 1 = (xi == bmap->cols - 1 J| yi == bmap->rows - 1 ? gOO : PtrX1 Y1[0J); 
g1 = gOO * (1.0 - dx) + g01 * dx; 
g2 = g10*(1.0-dx) + gll *dx; 
PtrfO] = g1 *(1.0-dy) + g2*dy; 

gOO = PtrXY[1] ; 

g01 ~ (xi == bmap->cols - 1 ? gOO : PtrX1[1]); 
g1 0 = (yi == bmap->rows - 1 ? gOO : PtrY1 [1]); 

g1 1 = (xi == bmap->cols - 1 Jj yi == bmap->rows - 1 ? gOO : PtrX1 Y1M])- 
g1 = gOO * (1 .0 - dx) + g01 * dx; ' 
g2 = gl0*(1.0-dx)+g11 *dx; 
Ptr[1] = g1 *(1.0-dy) + g2*dy; 

gOO = PtrXY[2] ; 

g01 = (xi == bmap->cols - 1 ? gOO : PtrXl[2]); 
g10 = (yi == bmap->rows - 1 ? gOO : PtrY1[2]); 

g1 1 = (xi == bmap->coIs - 1 If yi == bmap->rows - 1 ? gOO • PtrX1 Yir21V 

gi =goo*(i.o-dx) + g oi *dx; 

g2 = g10-(1.0-dx) + g11 * dx; 
Ptr[2] = g1 * (1 .0 - dy) + g2 * dy ; 

return (0.0); 

} 

int PASCAL split_bitmap_frame(MYB!TMAP "SrcBmap MYBJTMAP -F1 
MYBITMAP **F2) ' 
{ 

int Rows.Cols.MidRows ; 
DWORD Size.Limit.indx ; 
int i.ColorFactor ; 
BYTE huge * CurrPtr; 
BYTE huge * Ptr; 

Rows = SrcBmap->rows ; 
Cols = SrcBmap->cols ; • 
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if ( SrcBmap->typ = COLOR_MODEL ) ColorFactor = 3 ; 
else ColorFactor = 1 ; 
if ( Rows %2 == 0 ) { 

MidRows = Rows/2 ; 
}else{ 

MidRows = Rows/2 +1 ; 

} 

Size = (DWORD)MidRows*(DWORD)CoIs*(DWORD)ColorFactor ; 
*F1 = bm_alloc(Cols,MidRows,SrcBmap->typ) ; 

(*F1)->gpic = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 

Limit = (DWORD)Cols*(DWORD)ColorFactor ; 

CurrPtr = (*F1 )->gpic ; 

for ( i = 0 ; i < Rows ; i+=2 ) { 

if ( ColorFactor == 1 ) { 
Ptr = BITMAP_PLACE_PTR(SrcBmap,i,0) ; 

}else{ 

Ptr = BITMAP_RGB_PLACE_PTR(SrcBmap,i,0) ; 

} 

for ( indx = 0 ; indx < Limit ; indx++ ) { 
*(CurrPtr++) = *(Ptr++) ; 

} 

} 

MidRows - Rows - MidRows ; 

Size = (DWORD)MidRows-(DWORD)Cols-(DWORD)ColorFactor ; 
*F2 = bm_alioc(Cols, MidRows, SrcBmap->typ) ; 

(*F2)->gpic = (BYTE huge")GlobalAIIocPtr(GMEM_MOVEABLE,Size) ; 

CurrPtr = (*F2)->gpic ; 

for ( i = 1 ; i < Rows ; i+=2 ) { 

if ( ColorFactor == 1 ) { 
Ptr = BITMAP_PLACE_PTR(SrcBmap,i,0) ; 

}else{ 

Ptr = BITMAP_RGB_PLACE_PTR(SrcBmap,i,0) ; 

} 

for ( indx = 0 ; indx < Limit ; indx++ ) { 
*(CurrPtr++) = *(Ptr++) ; 

} 

> 

3^3 
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return 1 ; 

} 

int PASCAL sum_greyj3itmap_vaiue(MYBITMAP *Bmap,DWORD *Sum) 
{ 

DWORD i; 
int Cols,Rows ; 
DWORD Size ; 
DWORD CurrSum ; 
BYTE huge *Ptr ; 

Cols = Bmap->co!s ; 
Rows = Bmap->rows ; 
Ptr = Bmap->gpic ; 

Size = (DWORD)Cols*(DWORD)Rows ; 
CurrSum = 0 ; 
for ( i = 0 ; i < Size ; i++ ) { 
CurrSum += *(Ptr++) ; 

} 

*Sum = CurrSum ; 
return 1 ; 

} 

int PASCAL fi!ter_noises_by_rects(MYB!TMAP *Source,RECT Rectan.int 
LowLimit, 

int HighLimit,MYBJTMAP Target) 

{ 

int i,j ; 

int Count = 0 ; 

int Left, Right.Top, Bottom ; 

int Value ; 

Left = Rectan. left ; 
Top = Rectan. top ; 
Right = Rectan. right ; 
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Bottom = Rectan.bottom ; 

for ( i = Top ; i < Bottom ; i++ ) { 
for (j= Left; j < Right ;j++){ 

if ( BlTMAP_PLACE(Source,i,j) == 0 ) Count++ ; 

} 

} 

Value =-1; 

if ( Count < LowLimit ) Value = 1 ; 
if ( Count > HighLimit ) Value = 0 ; 
if ( Value == -1 ) return 1 ; 

for ( i = Top ; i < Bottom ; i++ ) { 
for (j = Left ; j < Right ; j++ ) { 

BrrMAP_PLACE(Target,i,j) = Value ; 

} 

} 

return 1 ; 

} 
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int qrsolv(M,size,b) 

Solves the linear system : Mx = b using the QR Decomposition. 
On output b is overwritten by the solution x. 

* Algorithm : 

1) qrdecomp M into Q & R (coded in M,m1,m2). 

2) multiply b by Q(transpose). 

3) R_solve Rx=Q(transpose)b. ' 

* C Implementaion: Dr. I. Wilf.. 
*/ 

#define ORDER 8 
#include<math.h> 
#include "qrsolv.h" 

int qrsolv (m, size, b) 
double m[ORDER][ORDER]; 
int size ; 

double bfORDER]; 
{ 

int i, 

j; 

double tau, 

ml [ORDER], 
m2[ORDER]; 

if (qrdecomp (m, size, ml , m2) < 0) return 0 ; 

//error ("singularity in qrdecomp()\n"); 
for (j = 0; j < (size - 1 ); { 
tau = 0; 

for (i = j; i < size; i++) 

tau += m[i]0] * b[ij; 
tau/=m1[j]; 
for (i = j; i < size: i++) 

b[i] -= tau • m[i]H; 

} 

b[size - 1] /= m2[size - 1]; 
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rsolv (m, size, m2, b); 

} 

r 

Compute the QR decomposition of a square matrix m using the 
Stewart 

* algorithm. 

* Upon termination , thr decomposition is stored in m,m1 and m2 as 
follows: 

R is contained in the upper triangle of m except that its main • 
diagonal is contained in m2, and Q(transpos)=Q(n-1)*...*Q(1) 
where QG')=l-(Uj"Uj(transpos)/Pj) where 
UjTO=0, i=1->j-1, UIi]=mri]D],i=j->n, Pj=m1[j]. 

* Stewart.G.W., Introduction to matrix Computations , Academic Press, 

New York (1973). 

* C Implementaion: Dr. I. Wilf. 
7 

int qrdecomp (m, size, ml, m2) 
double m[ORDER][ORDERJ; 
double ml [ORDER], 
m2[ORDER]; 

{ 

int i, 
k, 

j; 

double eta, 
t, 

sigma, 
tau; 

for (k = 0; k < (size - 1 ); k++) { 
eta = 0.0; 
for (i = k; i < size; 

if (fabs (m[i][k]) > eta) 
eta = fabs (m[i][k]); 
if (eta == 0.0) 
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return (-1 ); 
r form Qk and premultiply m by it */ 
t = 0; 

for (i = k; i < size; { 
m[i][k] /= eta; 
t+=m[i][k]-m[i][k]; 

} 

if(m[k][k] >= 0.0) 

sigms - sqrt(t); 

else 

sigma = -sqrt(t); 
m[k][k] += sigma: 
ml [k] - sigma * m[k][k]; 
m2[k] = (-eta * sigma); 
tau = 0; 

for (j = k + 1 ; j < size; j++) { 
tau = 0; 

for (i = k; i < size; 

tau += m[i][k] * m[i][fl; 
tau/=m1[k]; 
for (i = k; i < size; 

m[i][j] -= tau * m[i][k]; 

} 

} 

m2[size - 1] = m[size - 1][size - 1]; 
return (0); 

} 

/* 

rsolv(m,size,m2.b) 

solve Rx=b for b : where the upper triangular matrix R is 
stored in M , m2. 

* C Implementaion: Dr. I. Wilf. 
*/ 

rsolv (m, size, m2, b) 
double m[ORDER][ORDER]; 
double m2[ORDER], 
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bJORDER]; 

{ 

int i, 

j; 

double s; 

c 

for (i = size - 2; i >= 0; i-) { 
s = 0; 

for0=i + 1;j < size; 

s+= m[i]Q]*bD]; 
b[i]=(b[i]-s)/m2[i]; 

} 

} 
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#include <windows.h> 
#include <windowsx.h> 
#include <commdlg.h> 
#include <stdlib.h> 
#include <bios.h> 
#include "const, h" 
#include "b'rtmap.h" 
#include "persp.h" 
#include "iines.h" 
#include "track, h" 
#include "min_mag.h" 
#include "lib.h" 

int PASCAL l_cp_int_arr_to_RPOINT(RPOlNT -Rpoint, int -ArrX, int 'ArrY.int 

num) 

{ 

int i ; 

for ( i = 0 ; i < num ; i++ ) { 
Rpoint[i].x = ArrX[i] ; 
Rpoint[i].y = ArrYIi] ; 

} 

return 1 ; 
} 

int PASCAL l_quad_in_new_origin(RPOINT *NewQuad,RPOINT *Quad, 
int Xorg.int Yorg.int num) 

{ 

int i ; 

for ( i = 0 ; i < num ; i++ ) { 
NewQuad[i].x = Quad[i].x-Xorg ; 
NewQuad[i].y = Quad[i].y-Yorg ; 

} 

return 1 ; 
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int PASCAL l_copy_RPOINT_array(RPO!NT To.RPOlNT *From,int num) 
{ 

int i ; 

for ( i = 0 ; i < num ; i++ ) { 
To[i] = From[i] ; 

> 

return 1; 
} 

int PASCAL l_copy_int_array(int To, int *From,int num) 
{ 

int i ; 

for ( i = 0 ; i < num ; i++ ) { 
To[i] = From[i] ; 

} 

return 1 ; 

} 

int PASCAL l_find_bound_rect(RPOINT *Vertexes, RECT *Rectan) 
{ 

Rectan->left 

=(int)min(min(min(Vertexes[0].x,Vertexes[1].x),VertexesI2].x),Vertexes[3].x); 
Rectan->top - 

(int)min(min(min(Vertexes[0].y,Vertexes[1].y),VertexesI2].y),Vertexes[3].y); 
Rectan->right 

=(int)max(max(max(VertexesI0].x l Vertexes[1].x) l Vertexes[2].x),Vertexes[3].x); 
Rectan->bottom - 

(intJma^maxCmaxCVertexestOJ.y.Vertexeslll.yJ.Vertexespj.yJ.Vertexespj.y) ; 



return 1 ; 

} 
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int PASCAL find_extremes_in_1dim(RP0INT 'Points, int Number, int Dim, 
double *MaxVal, double *MinVal) 

{ 

int i ; 

double MaxNum, MinNum ; 

if ( Dim == X_DIM ) { 
MaxNum = MinNum = Points[0].x ; 
for ( i = 1 ; i < Number ; i++ ) { 
if ( Points[i].x > MaxNum ) { 
MaxNum = Points[i].x ; 
continue ; O 

} 

if ( Points[i].x < MinNum ) { 
MinNum = Points[i].x ; 
continue ; 

} 

} 

*MaxVal = MaxNum ; 
•MinVal = MinNum ; 

} 

if ( Dim == Y_DIM ) { 
MaxNum = MinNum = Points[0].y ; 
for ( i = 1 ; i < Number ; i++ ) { 
if ( Points[i].y > MaxNum ) { 
MaxNum = Points[i].y ; 
continue ; 

} 

if ( Points[i].y < MinNum ) { 
MinNum = Points[i].y ; 
continue ; 

} 

} 

•MaxVal = MaxNum ; 
•MinVal = MinNum ; 

} 
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return 1 ; 
} 

int PASCAL find_best_cluster(HWND hwnd, int Number, RPOINT 'Points, 
RPOINT *Ciuster,int *NumCluster,int Dim, 
int "Indexes, int *Clustlndex,RPOINT "NotCluster, int -Notlndexes) 

{ 

int ij.k ; 

int CounLNCount ; 
int Distance ; 
int Range ; 

double MaxNum.MinNum ; 
int *DistArray ; 
double *SumArray ; 
double MaxSum ; 
double MaxNumbers.Value ; 
int Maxindex ; 

if ( Number == 0 ) return 0 ; 

find_extremes_in_1dim(Points,Number,Dim,&MaxNum ! &MinNum) ; 
Range = (int)(fabs(MaxNum - MinNum+0.5)) ; 
DistArray = (int *) GlobalAllocPtr (GMEM_MOVEABLE, 

(DWORD)sizeof(int)*(DWORD)Number*(DWORD)Range 

); 

SumArray = (double *) GlobalAllocPtr (GMEM_MOVEABLE, 

(DWORD )sizeof ( double)"(D WORD) N umber) ; 

for ( i = 0 ; i < Number ) { 
SumArray[i] = 0.0 ; 
for ( j = 0 ; j < Range ; j++ ) { 

VALUEJN(DistArray,i,j, Range) = 0 ; 

} 

} 

for ( i = 0 ; i < Number ; i++ ) { 
for ( j = 0 ; j < Number ; j++ ) { 
if ( i == j ) continue ; 
for ( k = 1 ; k <- Range ; k++ ) { 
if ( Dim == X_DIM ) { 
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if ( fabs(PointsQ].x - PointsIi].x)<= (double)k ) { 
VALUE JN(DistArray,i,k-1 .Range) += 1 ; 

} 

} else { 

if ( fabs(PointsD].y - Points[i].y)<= (double)k ) { 
VALUE_IN(DistArray,i,k-1. Range) += 1 ; 

} 

} 

} 

} 

} 

MaxSum =0.0; 
Maxlndex = 0 ; 

for ( i = 0 ; i < Number ; i++ ) { 
for ( j = 0 ; j < Range ; j++ ) { 
SumArray[i] += (double)(VALUEJN(DistArray,ij,Range))/(double)(i+1); 

} 

if ( SumArray[i] > MaxSum ) { 
Maxlndex = i ; 
MaxSum = SumArray[i] ; 

} 

} 

MaxNumbers - 0.0 ; 

for ( i = 0 ; i < Range ; i++ ) { 
Value = (double)(VALUE_IN(DistArray,Maxlndex,i,Range))/(double)(i+1) ; 

if ( Value > MaxNumbers ) { 
MaxNumbers = Value ; 
Distance = i+1 ; 

} 

} 

if ( Range == 1 && MaxNumbers <= 2 ) { 
GlobalFreePtr(SumArray) ; 
GlobalFreePtr(DistArray) ; 
return 0 ; 
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} . 

if ( Range > 1 && MaxNumbers < (double)Number/((double)Range-K).01) ) { 
GlobalFreePtr(SumArray) ; 
GlobalFreePtr(DistArray) ; 
return 0 ; 

} 

Count = N Count = 0 ; 
for ( j = 0 ; j < Number ; ) { 
rf ( Dim == X_DIM ) { 
if ( fabs(PointsO].x - Points[Maxlndex].x)<= (double)Distance ) { 
Cluster[Count] = Pointsfj] ; 
Clustindex[Count++] = IndexesO] ; 
} else { 

NotCluster[NCount] = PointsQ] ; 
Notlndexes[NCount++] = Indexesfj] ; 

} 

} else { 

if ( fabs(Pointsfj].y - Points[Maxlndex].y)<= (double)Distance ) { 

CiustenXount] = PointsD] ; 

CIustlndex[Count++] = lndexesrj] ; 
} else { 

NotCluster[NCount] = Points[j] ; 
Notlndexes[NCount++] = tndexesQ] ; 

} 

} 

} 

*NumCluster = Count ; 
GlobalFreePtr(SumArray) ; 
GlobalFreePtr(DistArray) ; 



return 1 ; 
} 

int PASCAL prinMransform(HFILE hFile.char * Head,Perspective_Transform 
{ 
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int j ; 

char String[50] ; 

jwrite(hFile,Head,strlen(Head)) ; 
for(j = 0; j < 3 ; j++){ 

sprintf(String,"Vi%lf, %lf, %lf\n",Tp->PfIj][0], 
Tp^PfHlUTp^RDlPl) ; 

_lwrite(hFile,String,strlen(String)) ; 

> 

return 1 ; 



int PASCAL insert_new_vertexes(RPOINT *CurrVert, RPOINT «Vert1. 
RPOINT *Vert2, 

RPOINT *Vert3, RPOINT *Vert4,double -WheighLint num.RPOINT 
*NewVert) 
{ 

int i ; 

RPOINT Delta[4] ; 
double Sum ; 

Sum = Wheight[0] + Wheight[1 ] + Wheight[2] ; 
for ( i = 0 ; i < num-1 ; i++ ) { 

Vert1[i] = Vert1[i+1]; 

Vert2[i] = Vert2[i+1] ; 

Vert3[i] = Vert3[i+1] ; 

Vert4[i] = Vert4[i+1] ; 

} 

Vertl [num-1 ] = CurrVert[0] ; 
Veri2[num-1] = CurrVert[1] ; 
Vert3[num-1] = CurrVert[2] ; 
Vert4[num-1] = CurrVert[3] ; 

for ( i = 0 ; i < num-1 ; i++ ) { 
Delta[i].x = Vertl [i+1 ].x - Vertl [i].x ; 
Delta[i].y = Vertl [i+1].y - Vertl [i].y ; 
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Delta[2].x ==(Delta[2].x-Wheight[2] + Delta[1].x*Wheight[1] + 
Delta[0].x*Wheight[0])/Surn ; 

Delta[2].y =(Delta[2].y*Wheight[2] + Delta[1].y*Wheight[1] + 
Delta[0].y*Wheight[0])/Sum ; 

NewVert[0].x = Vert1[2].x + Delta[2].x ; 
NewVert[0].y = Vert1[2].y + Delta[2].y ; 

for ( i = 0 ; i < num-1 ; i++ ) { 
Delta[i].x = Vert2[i+1].x - Vert2[i].x ; 
Delta[fl.y = Vert2[i+1 ].y - Vert2[i].y ; 

Delta[2].x =(Delta[2].x*Wheight[2] + Delta[1].x*Wheight[1] + 
Delta[0].x*Wheight[0])/Sum ; 

Delta[2].y =(Delta[2].y*Wheight[2] + De!ta[1].y*Wheight[1] + 
Delta[0].y*Wheight[0])/Sum ; 

NewVert[1].x = Vert2[2].x + Delta[2].x ; 

NewVert[1].y = Vert2[2].y + Delta[2].y ; 

for ( i = 0 ; i < num-1 ; i++ ) { 
De!ta[i].x = Vert3[i+1].x - Vert3[i].x ; 
Delta[i].y = Vert3[i+1].y - Vert3[i].y ; 

} 

De1ta[2].x =(De!ta[2].x*Wheight[2] + Delta[1].x*Wheight[1] + 
Delta[0].x , Wheight[0])/Sum ; 

Delta[2].y =(Delta[2].y*Wheight[2] + Delta[1].y*Wheight[1] + 
Delta[0].y*Wheight[0])/Sum ; 

NewVert[2].x = Vert3[2].x + Delta[2].x ; 

NewVert[2].y = Vert3[2].y + Delta[2].y ; 

for ( i = 0 ; i < num-1 ; i++ ) { 
Delta[i].x = Vert4[i+1].x - Vert4[i].x ; 
Delta[i].y = Vert4[i+1].y - Vert4[i].y ; 

} 

Delta[2].x =(Delta[2].x*Wheight[2] + Delta[1].x*Wheight[1] + 
Delta[0].x-Wheight[0])/Sum ; 

Delta[2].y =(Delta[2].y*Wheight[2] + Delta[1].y"Wheight[1] + 
Delta[0].y*Wheight[0])/Sum ; 

NewVert[3].x = Vert4[2].x + De!ta[2].x ; 
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NeWVert[3].y = Vert4[2].y + Delta[2].y ; 



return 1 ; 

} 

int PASCAL transform_rpoint_arr(RPOINT -SrcPnts, RPOINT *DstPnts, 
int num ,Perspective_Transform TpCurr ) 

{ 

double DstX,DstY,w ; 
int i ; 

for ( i = 0 ; i < num ; i++ ) { 
DstX = SrcPnts[i].x * TpCurr. Pf[0][0] + 

SrcPntspJ.y *TpCurr.Pf[1][0] + TpCurr.Pf[2][0] ; 
DstY = SrcPnts[i].x * TpCurr. Pf[0][1] + 

SrcPnts[i].y *TpCurr.Pf[1][1] + TpCurr.PfI2][1] ; 
w = SrcPnts[i].x * TpCurr. PflOp] + 

SrcPnts[i].y * TpCurr. Pf[1][2] + TpCurr.Pf[2][2] ; 
DstPnts[i].x = DstX/w ; 
DstPnts[i].y = DstY/w ; 

} 

return 1 ; 
} 



33S 

SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCT/US94/0J679 



#include <windows.h> 
#inc!ude <v/mdowsx.h> 
#include <commdlg.h> 
#include <stdlib.h> 
^include "const, h" 
#include "b'rtmap.h" 
#include "iines.h" 
#include "track-h" 
#include "persp.h" 
#include "min_mag.h" 
#include Tib.h" 

int PASCAL improve_diffJ>rnap(MYBITMAP * MYBITMAP *) ; 
int PASCAL copy_rect_bmap(int ,int .MYBITMAP "MYBITMAP *); 

int PASCAL perspective(HWND hwnd.MYBITMAP FAR 'SrcBmap, 
MYBITMAP FAR *DstBmap, 

RPOINT- SrcPnts.RPOINT * DstPnts.int ColorModel, 

Perspective_Transform *Tp) 

{ 

//Rectan2Quad(hwnd,SrcPnts, DstPnts.Tp); 
Quad2Quad(hwnd,SrcPnts, DstPnts.Tp); 

Perspective_map(SrcBmap, Tp. DstBmap, DstPnts.ColorModel); 
return TRUE ; 

} 

int PASCAL perspective_near(HWND hwnd.MYBITMAP FAR *SrcBmap, 
MYBITMAP FAR *DstBmap. 

RPOINT" SrcPnts.RPOINT * DstPnts.int ColorModel, 

Perspective_Transform *Tp) 

{ 

//Rectan2Quad(hwnd,SrcPnts, DstPnts.Tp); 
Quad2Quad(hwnd,SrcPnts. DstPnts.Tp); 

Perspective_near_map(SrcBmap. Tp. DstBmap. DstPnts.ColorModel); 
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return TRUE ; 

} 

int PASCAL Rectan2Quad(HWND hwnd, RPOINT *src_pts, RPOINT 
*dst_pts, 

Perspective_Transform *Tp) 

{ 



double 


xO, yO, x1, y1, x2, y2, x3, y3; 


double 


dx1, dy1, dx2, dy2, dx3, dy3; 


double 


denom ; 


double 


a11, a12, a13, a21, a22, a23, a31, a32, a33; 


double 


A[3][3], B[3][3]; 


r Verify that src_pts do form a rectangle */ 



if ( check_if_rect(src_pts) == FALSE ) { 

MessageBox (hwnd, "Source is not a rectangle", 
"Perspective trans.", MBJCONEXCLAMATION I MB_OK) ; 
return NULL ; 

} 

r Solve for transformation from [(O.OJ.CI.I )] -> Quad */ 

xO = dst_pts[0].x; 

yO = dst_pts[0].y; 

x1 =dst _pts[1].x; 

y1 =dst_pts[1].y; 

x2 = dst_pts[2].x; 

y2 = dst_pts[2].y; 

x3 = dst_pts[3].x; 

y3 = dst_pts[3].y; 

dx1 = x1 - x2; 

dy1 = y1 - y2; 

dx2 = x3 - x2; 

dy2 = y3-y2; 

dx3 = xO - x1 + x2 - x3; 

dy3 = yO - y1 + y2 - y3; 
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r if dx3 = dy3 = 0: transformation is affine */ 
r otherwise: transformation is perspective 7 

r 

* Forward transformation: 

* [x_,y_,wj = [u,v,1] Pf 

•where: |a1 1 a12 a13| Pf = |a21 a22 a23| |a31 a32 a33| 

* Then: [x, y] = [x_/w_, y_/wj 
7 

denom = det2(dx1, dx2, dy1, dy2); 

a13 = det2(dx3, dx2, dy3, dy2) / denom; 
a23 = det2(dx1 , dx3, dy1 , dy3) / denom; 
a11 =x1 -xO + a13*x1; 
a21 = x3 - xO + a23 * x3; 
a31 = xO; 

a12 = y1 -y0 + a13*y1; 
a22 = y3 - yO + a23 • y3; 
a32 = yO; 
a33 = 1.0; 



A[0][0] = a11; 
A[0][1] = a12; 
A[0][2] = a 13; 
A[1][0] = a21; 
A[1][1] = a22; 
A[1][2] = a23; 
A[2][0] = a31; 
A[2][1] = a32; 
A[2][2] = a33; 
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r pre-multiply by the matrix converting src_pts->[(0,0),(1,1)] 
{ 



double 


xs = 


src_pisiuj.x, 


double 


ys = 


src_pts[0].y; 


double 


xe = 


src_pts[2].x; 


double 


ye = 


src_pts[2].y; 


double 


dx = 


xe - xs; 


double 


dy = 


ye - ys; 


B[0][0] = 


1.0 /dx; 




B[1][0] = 


0.0; 




B[2][0] = 


-xs / dx; 




B[0][1] = 


0.0; 




B[1][1] = 


1 .0 / dy; 




B[2][1] = 


-ys / dy, 




B[0][2] = 


0:0; 




B[1][2] = 


0.0; 




B[2][2] = 


1.0; 





multmat(hwnd,3, 3, 3, (double^B, (double-)A, (double*)(Tp->Pf)); 

} 

r 

* Backward transformation: 

* [u_,v_,wj = [x,y,1] Pb 

•where: |A11 A12 A13| Pb = |A21 A22 A23| |A31 A32 A33| 

* is the inverse of Pf. 

•Then: [u, v] = [u_/w_, v_/wj 
*/ 

{ 

a11 =Tp->PfT0][0]; 
a12 = Tp->PfI0][1); 
a13 = Tp->PfI0][2]; 
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a21=Tp->PfI1][0]; 
a22 = Tp->Pf[1][1]; 
a23 = Tp->Pfl1][2]; 
a31 =Tp->PfI2][0]; 
a32 = Tp->PfI2][1]; 
a33 = Tp->Pf[2][2]; 

} 



Tp->Pb[0][0] = a22 * a33 - a23 * a32; 
Tp->Pb[0][1] = a13 * a32 - a12 * a33; 
Tp->Pb[0][2] = a12 * a23 - a13 * a22; 
Tp->Pb[1][0] = a23 * a31 - a21 * a33; 
Tp->Pb[1][1] = a11 *a33-a13*a31; 
Tp->Pb[1][2] = a13 * a21 - a11 * a23; 
Tp->Pb[2][0] = a21 * a32 - a22 * a31; 
Tp->Pb[2][1] = a12 * a31 - a1 1 * a32; 
Tp->Pb[2][2] = a1 1 ' a22 - a12 * a21; 



return 1 ; 

} 



int PASCAL Quad2Rectan(HWND hwnd, RPOINT *src_pts, RPOINT 
*dst_pts, 

Perspective_Transform *Tp) 

{ 

double Tmp ; • 



Rectan2Quad(hwnd,dst_pts,src_pts,Tp) ; 



Tmp = Tp->PfI0][0] ; 
Tp->PfI0][0] = Tp->Pb[0][0] ; 
Tp->Pb[0][0] = Tmp ; 



Tmp = Tp->Pf[0][1]; 
Tp->Pfl0][1] = Tp->Pb[0][1] ; 
Tp->Pb[0][1] = Tmp ; 



Tmp = Tp->PfI0J[2] ; 
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Tp->Pf[0][2] = Tp->Pb[0][2] ; 
Tp->PbI0][2] = Tmp ; 

Tmp = Tp->Pf[1][0]; 
Tp->PfI1][0] =Tp->Pb[1][0]; 
Tp->Pb[1][0] = Tmp ; 

Tmp = Tp->Pf[1][1]; 
Tp->Pf[1][1] =Tp->Pb[1][1]; 
Tp->Pb[1][1] = Tmp; 

Tmp=Tp->PfI1][2]; 
Tp->PfI1][2] = Tp->Pb[1][2] ; 
Tp->Pb[1][2] = Trnp ; 

Tmp = Tp->Pf[2][0] ; 
Tp->Pf[2][0] = Tp->Pb[2][0] ; 
Tp->Pb[2][0] = Tmp ; 

Tmp = Tp->Pf[2][1]; 
Tp->PfI2][1] =Tp->Pb[2][1]; 
Tp->Pb[2][1] = Tmp; 

Tmp = Tp->Pf[2][2] ; 
Tp->PfI2][2] = Tp->Pb[2][2] ; 
Tp->Pb[2][2] = Tmp ; 



return 1 ; 

} 



int PASCAL check_if_rect(RPOINT* Points) 
{ 

if ( Points[0].x != Points[3].x ) return FALSE ; 
if ( Points[1].x != Points[2].x ) return FALSE ; 
if ( Points[0].y != Points[1].y ) return FALSE ; 
if ( Points[2].y != Points[3].y ) return FALSE ; 



SUBSTiTUTE SHEET (RULE 26) 



WO 95/10919 PCT/US94/01679 



return TRUE ; 

} 

int PASCAL Perspective_near_map(MYBITMAP 
*src_bmap,Perspective_Transform* Tp, 

MYBITMAP *dst_bmap, RP01NT *dst_pts,int ColorModel) 

{ 

RECT r, Screen; 
DWORD i.j; 
DWORD Size ; 

BYTE huge *Ptr ; 
double RcBil ; 

int Colsmin1,Rowsmin1 ; 
double y_dst ; 

double x_dst ; 

RPOINT uv, xy; 

double D ; 

BYTE huge *Colors ; 
int uy.ux ; 

J* Find bounding rectangle of dst_pts */ 
l_find_bound_rect(dst_pts. &r) ; 

Colsminl = src_bmap->cols -1 ; 
Rowsminl = src_bmap->rows -1 ; 

Colors = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,3) ; 

for (i = r.top; i < r.bottom; { 
y_dst = (double) i; 
for G = r.left; j < r.right; { 
x_dst = (double) j; 
D=1.0; 

xy.x = x_dst; 
xy.y = y_dst; 

uv = bPerspective(xy, Tp); 

if (uv.x < 0.0 || uv.x >= (double) (src_bmap->cols-1 )) 
3^5 
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continue; 

if (uv.y < 0.0 || uv.y >= (double) (src_bmap->rows-1 )) 
continue; 

uy = (int)(uv.y+0.5) ; 
ux = (int)(uv.x+0.5) ; 
if ( CoiorModel == GREY_MODEL ) { 

RcBil = BITMAP_PLACE(src_bmap,uy,ux) ; 
BrTMAP_PLACE(dst_bmap,ij) = (BYTE)RcBil ; 
}eise { // COLOR_MODEL 

Ptr = BITMAP_RGB_PLACE_PTR(dst_bmap,ij) ; 

Colors = BITMAP_RGB_PLACE_PTR(src_bmap,uy,ux) ; 

Ptr[0] = (BYTE)Colors[0] ; 

Ptr[1] = (BYTE)Colors[1]; 

Ptr[2] = (BYTE)Colors[2J ; 

} 

} 

} 

GlobalFreePtr(Colors) ; 
return (0); 

} 



int PASCAL Perspective_map(MYBITMAP FAR 
*src_bmap f Perspective_Transform*Tp, 

MYBITMAP FAR *dst_bmap, RPOINT *dst_pts,int CoiorModel) 

{ 



RECT 


r, Screen; 


DWORD 


U; 


DWORD 


Size ; 


BYTE huge "Ptr ; 


double 


RcBil ; 


int Colsmin1,Rowsmin1 ; 


double 


y_dst; 


double 


x_dst ; 


RPOINT 


uv, xy, 


double 


D ; 


double 


Colors[3] ; 
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T Find bounding rectangle of dst_pts */ 
l_find_bound_rect(dst_pts, &r) ; 

Colsminl = src_bmap->cols -1 ; 
Rowsminl = src_bmap->rows -1 ; 

for (i = r.top; i < r. bottom; i++) { 
y_dst = (double) i; 
for (j = r.left; j < r.right; j++) { 
x_dst = (double) j; 
D=1.0; 

xy.x = x_dst; 
xy.y = y_dst; 

uv = bPerspective(xy, Tp); 
if (uv.x < 0.0 || uv.x >= (double) (src_bmap->cols)) 
continue; 

if (uv.y < 0,0 || uv.y >= (double) (src_bmap->rows)) 
continue; 

if ( ColorModel == GREY_MODEL ) { 

RcBil = (BYTE)bilinear(uv.x,uv.y, src_bmap); 
if ( RcBil == -1 .0 ) continue ; 
BITMAP_PLACE(dst_bmap,i,j) = (BYTE)RcBil ; 
}else { // COLOR_MODEL 

Ptr = BITMAP_RGB_PLACE_PTR(dst_bmap,i,j) ; 

bi!inear_rgb(uv.x,uv.y,src_bmap,Colors) ; 

PtrfO] = (BYTE)Colors[0] ; 

Ptr[1] = (BYTE)Coiors[1] ; 

Ptr[2] = (BYTE)Colors[2] ; 

} 

} 

} 

return (0); 

} 
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RPOINT bPerspective(RPOINT xy, Perspective_Transform *Tp) 
{ 



RPOINT 

double 

double 

double 

double 

double 



x = xy.x; 
y = xy.y; 

u_ = x * Tp->Pb[0][0] + y * Tp->Pb[1 J[0] + Tp->Pb[2][0]; 
v_ = x -Tp->Pb[0][1] + y •Tp->Pb[1][1] + Tp->Pb[2][1J; 
w_ = x * Tp->Pb[0][2] + y «Tp->Pb[1][2] + Tp->Pb[2][2]; 



uv.x = u_ / w_; 
uv.y = v_ / w_; 
return (uv); 



RPOINT PASCAL fPerspective(RPOINT xy, PerspectiveJTransform *Tp) 

{ . 



RPOINT 

double 

double 

double 

double 

double 



x = xy.x; 
y = xy.y; 

u_ = x * Tp->Pf[0][0] + y * Tp->Pf[1 ][0] + Tp->Pf[2][0]; 
v_ = x - Tp->Pf[0][1 ] + y * Tp->Pfl1 ][1 ] + Tp->PfI2][1]; 
w_ = x * Tp->PfI0][2] + y * Tp->Pf[1 ][2] + Tp->Pf[2][2]; 



uv.x = u_/ w_; 
uv.y = v_ / w_; 
return (uv); 



double PASCAL dPerspective(RPOINT xy, Perspective_Transform *Tp) 
{ 

double Du, Dv, D; 

double Dux, Duy; 

double Dvx, Dvy; 



double 
double 



x - xy.x; 
y = xy.y; 
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double u_ = x * Tp->Pb[0][0] + y * Tp->Pb[1 ][0] + Tp->Pb[2][0]; 
double v_ = x *tp->Pb[0][1] + y • Tp->Pb[1][1] + Tp->Pb[2][1]; 
double w_ = x • Tp->Pb[0}[2] + y * Tp->Pb[1][2) + Tp->Pb[2][2]; 

double u_x = Tp->Pb[0][0]; 

double u_y = Tp->Pb[1 ][0J; 

double v_x = Tp->Pb[0][1]; 

double v_y = Tp->Pb[1 ]{1 ]; 

double w_x = Tp->Pb[0][2]; 

double w_y = Tp->Pb[1][2]; 

Dux = (u_x * w_ - u__ * w_x) / (w_ * w _); 
Duy = (u_y * w_ - u_ * w_y) / (w_ * w_); 
Du = sqrt(Dux * Dux + Duy * Duy); 

Dvx = (v_x * w_ - v_ * w_x) / (w_ * w_); 
Dvy = (v_y * w_ - v_ * w_y) / (w_ * w __); 
Dv = sqrt(Dvx * Dvx + Dvy * Dvy); 

D = max(Du, Dv); 

return (D); 

} 



#define MEDIAN_EDGE 5 
#define MEDIAN_SIDE 2 

int PASCAL median_filter_5(HWND hwnd.MYBITMAP •Bmap) 
{ 

int i, j ,k,I,n; 

int MedVec[MEDIAN_EDGE-MEDIAN_EDGE] ; 
BYTE lndexArr[256] ; 
int Median ; 

MYBITMAP TmpBmap ; 
BYTE huge TmpPtr ; 
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BYTE huge 'BmapPtr ; 
DWORD Size, PI ; 
DWORD FromTime.ToTime ; 
char String[100] ; 
int Sum ; 

int RowLimit , ColLimit ; 

TmpBmap = bm_alloc(Bmap->cois,Bmap->rows 1 GREY_MODEL) ; 
Size = (DWORD)Bmap->cols*(DWORD)Bmap->rows ; 
TmpBmap->gpic = (BYTE huge*)Globa!A!locPtr(GMEM_MOVEABLE,Size) ; 
BmapPtr = Bmap->gpic ; 
TmpPtr = TmpBmap->gpic ; 
for ( PI = 0 ; PI < Size ; PI++ ) { 
*(TmpPtr++) = *(BmapPtr++) ; 

} 

for ( i = 0 ; i < Bmap->rows ; i++ ) { 
for ( j = 0 ; j < Bmap->cols ; j++ ) { 

if ( BITMAP_PLACE(TmpBmap,i j) <= 24 ) { 
B ITM AP_PLAC E(TmpB map, i j) = 0 ; 

} 

} 

} 

WriteGreyRgb (hwnd,"no48.rgb",TmpBmap) ; 
//FromTime = GetTickCount() ; 

RowLimit = Bmap->rows -3 ; 
for ( i = 2 ; i < RowLimit ; i++ ) { 
for ( k = 0 ; k < 256 ; k++ ) lndexArr[k] =0 ; 
f or ( j = 0 ; j < 5 ; j++ ) { 
lndexArr[BlTMAP_PLACE(TmpBmap,i-2,j)] += 1; 
lndexArr[BnrMAP_PLACE(TmpBmap,i-1j)]+= 1 ; 
lndexArrrBITMAP_PLACE(TmpBmap,i 1 j)] += 1 ; 
lndexArrrB[TMAP_PLACE(TmpBmap,i+1,j)] += 1 ; 
lndexArr[Bn"MAP_PLACE(TmpBmap,i+2 I j)] += 1 ; 

> 

for ( Sum = k = 0 ; k < 256 ; k++ ) { 
Sum += lndexArr[k] ; 
if(Sum>=13){ 
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BUMAP_PLACE(TmpBmap,i.2) = k ; 
break ; 

} 

} 

ColLimit = Bmap->cols - 3; 
for ( j = 3 ; j < ColLimit ; j++ ) { 

lndexArr[BrTMAP_PI_ACE(TmpBmap,i-2,j-3)] -= 1 ; 

lndexArr[BITMAP_PLACE(TmpBmap,i-1 j-3)] -= 1 ; 

lndexArrrBrrMAP.PLACErrmpBmap.ij-S)] -= 1 ; 

lndexArr[BITMAP_PLACE(TmpBmap,i+1,j-3)] -= 1 ; 

lndexArr[BITMAP_Pl_ACE(TmpBmap,i+2 1 j-3)] -= 1 ; 

lndexArr[BITMAP_PLACE(TmpBmap,i-2 I j+2)] += 1 ; 
lndexArr[BITMAP_PLACE(TmpBmap,i-1 j+2)] += 1 ; 
lndexArr[BITMAP_Pl_ACE(TmpBmap,i,j+2)] += 1 ; 
lndexArr[BITMAP_PLACE(TmpBmap,i+1j+2)]+=1 ; 
lndexArr[BrrMAP_PLACE(TmpBmap,i+2j+2)] += 1 ; 
for ( Sum = k = 0 ; k < 256 ; k++ ) { 

Sum += lndexArr[k] ; 

if(Sum>=13){ 

BITMAP_PLACE(TmpBmap,i,j) = k ; 
break ; 

} 

} 

} 

} 

WriteGreyRgb (hwnd,"med5.rgb",TmpBmap) ; 
//ToTime = GetTickCount() ; 

//sprintf(String,'Time elapsed = %lu".ToTime-FromTime) ; 

//MessageBox (hwnd, String,"Median Calc", MB_ICONEXCLAMATION | 
MB_OK) ; 
improve_diff_bmap(Bmap,TmpBmap) ; 

bm_free(TmpBmap) ; 

return 1; 
} 

int PASCAL improve_diff_bmap(MYBITMAP *Bmap,MYBITMAP TmpBmap) 
S5I 
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{ 

int i,j ; 

int ICount,JCount ; 

int Frj ; 

int Limit ; 

int Cols, Rows ; 

Frj = 0 ; 
JCount = 0 ; 
Cols = Bmap->cols ; 
Rows = Bmap->rows ; 
Limit = Bmap->rows / 8 ; 
for ( j = 0 ; j < Cols ; j++ ) { 
ICount = 0 ; 

for ( i = 0 ; i < Rows ; i++) { 

if ( BITMAP_PLACE(TmpBmap,i,j) != 0 ) ICount++ ; 

} 

if ( ICount < Limit ) JCount++ ; 
else{ 

if ( JCount > 0 ) {■ 

copy_rect_bmap(Frj,JCount,TmpBmap,Bmap) ; 

JCount = 0 ; 

} 

Frj = j+1 ; 

} 

} 

return 1 ; 
} 

int PASCAL copy_rect_bmap(int FromCol.int NumCols.MYBITMAP 

*From,MYB!TMAP *To) 

{ 

int i, j ; 
int Until ; 

Until = FromCol + NumCojs ; 
for ( j = FromCol ; j < Until ; j++ ) { 
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for ( i = 0 ; i < From->rows ; i++ ) { 

B!TMAP_PLACE(To,i,j) = BITMAP_PLACE(From,i,j) ; 

} 

} 

return 1 ; 

} 

int PASCAL get_tresh_for_occ(MYBITMAP *Bmap,int Tresh) 
{ 

DWORD Size.n ; 
BYTE huge TmpPic ; 
DWORD lndexArr[25S] ; 
int i ; 

DWORD Sum, MidSize ; 

for ( i = 0 ; i < 256 ; i++ ) { 
IndexArr[i] = 0 ; 

} 

Size = (DWORD)(Bmap->cols)*(DWORD)(Bmap->rbws) ; 
TmpPic = Bmap->gpic ; 
for ( n = 1 ; n < Size ; n++ ) { 
lndexArr[*(TmpPic++)] += 1 ; 

} 

MidSize = Size/2 ; 
Sum = 0 ; 

for ( i = 0 ; i < 256 ; i++ ) { 
Sum += IndexArrp] ; 
if ( Sum >= MidSize ) { 

*Tresh = i ; 

break ; 

} 

} 

if ( -Tresh < 32 ) Tresh = 32 ; 
return 1; 
} 
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int PASCAL perspective_mask(HWND hwnd , M YB ITMAP 
*SrcBmap, MYBITMAP *DstBmap, 

MYBITMAP * Alpha, RPOlNT'SrcPnts, RPOINT 'DstPnts, int 
ColorModel, 

int interpolation.MYBITMAP *MaskBmap) 

{ 

Perspective_Transform Tp ; 

//Rectan2Quad(hwnd,SrcPnts, DstPnts.&Tp); 
Quad2Quad(hwnd,SrcPnts, DstPnts.&Tp); 

Perspective_map_mask(SrcBmap, &Tp, DstBmap, Alpha, 
DstPnts, ColorModel, 

interpolation.MaskBmap); 

return 1 ; 

} 

int PASCAL Perspective_map_mask(MYB ITMAP FAR 
*src_bmap, Perspecti ve_Transf orm* Tp, 

MYBITMAP FAR *dst_bmap, MYBITMAP * Alpha, RPO I NT *dst_pts,int 
ColorModel, 

int interpolation.MYBITMAP 'MaskBmap) 

{ 

RECT r, Screen; 
DWORD i, j; 

DWORD Size ; 

BYTE huge *Ptr ; 
double RcBil ; 

double Colors[3] ; 

int AlphaNumber ; 

/* Find bounding rectangle of dst_pts */ 
l_find_bound_rect(dst_pts, &r) ; 

for (i = r.top; i < r.bottom; i++) { 
double y_dst = (double) i; 
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for G = r. left; j < r. right; { 
double x_dst = (double) j; 

RPOINT uv, xy; 

double D = 1.0; 

xy.x = x_dst; 
xy.y = y_dst; 

uv = bPerspective(xy, Tp); 
if (uv.x < 0.0 || uv.x >= (double) (src_bmap->cols)) 
continue; 

if (uv.y < 0.0 || uv.y >= (double) (src_bmap->rows)) 
continue; 

if ( ColorModel == GREY_MODEL ) { 

RcBil = (BYTE)bilinear(uv.x,uv.y, src_bmap); 
if ( RcBil==-1.0 || 

Bn"MAP_PLACE(MaskBmap,i-r.top,j-r.left) == 0 ) 

continue ; 

BITMAP_PLACE(dst_bmap,i,j) = (BYTE)RcBil ; 
} else { // COLOR_MODEL 

Ptr = BITMAP_RGB_PLACE_PTR(dst_bmap.i,j) ; 
RcBil = bilinear_rgb(uv.x,uv.y,src_bmap,Colors) ; 
if ( RcBil == -1.0 || 

BITMAP_PLACE(MaskBmap,i-r.top,j-r.left) == 0) continue 



if (BITMAP_PLACE(MaskBmap,i-r.top ) j-r.left) = 2 ) { 
Ptr[0] = 

(BYTE)((double)((DWORD)Colors[Or(DWORD)128 + 

(DWORD)Ptr[0]-(DWORD)128)/256.0) ; 
Ptr[1] = 

(BYTE)((double)((DWORD)Colors[1 ]*(DWORD)128 + 

(DWORD)Ptr[1]*(DWORD)128)/256.0) ; 
Ptr[2] = 

(BYTE)((double)((DWORD)Colors[2]-(DWORD)128 + 

(DWORD)Ptr[2]*(DWORD)128)/256.0) ; 
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continue ; 

} 

AlphaNumber = BITMAP_PLACE( Alpha, ij) ; 
if ( AlphaNumber > 1){ 
Ptr[0] = 

(BYTE)((double)((DW0RD)Colors[0r(DWORD)(256- 

AlphaNumber) + 

(DWORD)Ptr[0]*(DWORD)AlphaNumber)/256.0) ; 
Ptr[1] = 

(BYTE)((double)((DWORD)Colors[1]*(DWORD)(256- 

AIphaNumber) + 

(DW0RD)Ptr[1 ]*(DWORD)AlphaNumber)/256.0) ; 
Ptr[2] = 

(BYTE)((double)((DW0RD)Colors[2r(DWORD)(256- 

AlphaNumber) + 

(DWORD)Ptr[2]-(DWORD)A!phaNumber)/256.0) ; 

} else { 
PtrfO] = (BYTE)Colors[0] ; 
Ptr[1] = (BYTE)Colors[1]; 
Ptr[2] = (BYTE)Colors[2] ; 

} 



} 

} 

return (0); 

} 



int PASCAL perspective_al(HWND hwnd.MYBlTMAP FAR "SrcBmap, 
MYBITMAP FAR "DstBmap.MYBITMAP "Alpha, 
RPOINT* SrcPnts.RPOINT * DstPnts.int ColorModel, 
Perspective_Transform *Tp) 

{ 

//Rectan2Quad(hwnd,SrcPnts, DstPnts.Tp); 
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Quad2Quad(hwnd,SrcPnts, DstPnts.Tp); 

perspective_map_al(SrcBmap, Tp, DstBmap, Alpha.DstPnts.ColorModel); 
return TRUE ; 

} 

int PASCAL Perspective_map_a!(MYB!TMAP 
"src_bmap,Perspective_Transform Tp, 

MYBITMAP *dst_bmap, MYBITMAP *Alpha,RPOINT *dst_pts,int ColorModel) 
{ 

RECT r. Screen; 
DWORD i,j; 
DWORD Size ; 

BYTE huge-Ptr; 
double RcBil ; 

int Colsmin1,Rowsmin1 ; 
double y_dst; 
double x_dst; 
RPOINT uv.xy; 
double D ; 

double Colors[3]; 
int AlphaNumber; 



r Find bounding rectangle of dst_pts */ 
l_find_bound_rect(dst_pts, &r) ; 

Colsminl = src_bmap->cols -1 ; 
Rowsminl = src_bmap->rows -1 ; 

for (i = r.top; i < r.bottom; i++) { 
y_dst = (double) i; 
for (j = r.left; j < r.right; j++) { 
x_dst = (double) j; 
D = 1.0; 



xy.x = x_dst; 
xy.y = y_dst; 



357 



SUBSTITUTE SHEt ! (RUL.E2I 



WO 95/10919 



PCT/US94/01679 



uv = bPerspective(xy, Tp); 
if (uv.x < 0.0 || uv.x >= (double) (src_bmap->cols)) 
continue; 

if (uv.y < 0.0 || uv.y >= (double) (src_bmap->rows)) 
continue; 

if ( BITMAP_PLACE(Aipha,ij) == 0 ) continue ; 

if ( ColorModel == GREY_MODEL ) { 

RcBil = (BYTE)biIinear(uv.x,uv.y, src_bmap); 
if ( RcBil ==-1.0) continue ; 
BITMAP_PLACE(dst_bmap,i,j) = (BYTE)RcBil ; 
}else { // COLOR_M0DEL 

Ptr = BITM AP_R G B_PLAC E_PTR( dst_bmap, i , j) ; 
bilinear_rgb(uv.x,uv.y,src_bmap,Colors) ; 
AlphaNumber= BITMAP_PLACE( Alpha, ij) ; 
if ( AlphaNumber > 1 ) { 
Ptr[0] = 

(BYTE)((double)((DWORD)Colors[0]*(DWORD)(256- 

AlphaNumber) + 

(DWORD)Ptr[0]*(DWORD)AlphaNumber)/256.0); 
Ptr[1] = 

(BYTE)((double)((DWORD)Colors[ir(DWORD)(256- 

AlphaNumber) + 

(DWORD)Ptr[1]*(DWORD)AlphaNumber)/256.0) ; 
Ptr[2] = 

(BYTE)((double)((DWORD)Colors[2r(DWORD)(256- 

Alpha Number) + 

(DWORD)Ptr[2]*(DWORD)AlphaNumber)/256.0) ; 

}else{ 
Ptr[0] = (BYTE)Colors[0] ; 
Ptr[1]= (BYTE)Colors[1]; 
Ptr[2] = (BYTE)Colors[2] ; 

} 
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#include <windows.h> 
#include <windowsx.h> 
#include <commdlg.h> 
#include <stdlib.h> 
#include <bios.h> 
#include "consth" 
#include "bitmap.h" 
#include "persp.h" 
#include "lines.h" 
#include "track.h" 
#include "min_mag.h" 
#include "lib.h" 

int PASCAL get_quad_segment_on_x(LINE .LINE .double .double ,int 
.RPOINT*); 



int PASCAL mkline(double x1. double y1, double x2, double y2,LINE *!) 

l->a = y2-y1; 
l->b = x1-x2; 
l->c = -l->a * x1 -l->b • y1 ; 

return(1); 

} 

int PASCAL mksegment(double x1, double y1, double x2, double y2,SEG *s) 

s->a = y2 -yi; 

s->b = x1 -x2; 

s->c = -s->a * x1 -s->b *y1; 

s->xmax = max(x1,x2) ; 

s->xmin = min(x1,x2) ; 

s->ymax = max(y1 ,y2) ; 

s->ymin = min(y1 ,y2) ; 



return 1 
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int PASCAL get_point_on_segment(SEG s1, double param, RPOINT "Point) 
{ 

if ( param < 0.0 || param > 1.0 ) return 0 ; 
Point->x= param " (s1 .xmax-s1 .xmin) + sl.xmin ; 
Point->y = param * (s1 .ymax-s1 .ymin) + s1 .ymin ; 

return 1 ; 

} 

//this function returns in DstPnts the points calculated relative to the 
//Xparam and YParam always from the minimum. 

int PASCAL get_shrinked_yquad(RPOINT *SrcPnts, double param, RPOINT 

-DstPnts) 

{ 

SEG seg1,seg2,seg3,seg4 ; 
int i ; 

for ( i = 0 ; i < 4 ; i++ ) { 
DstPnts[i].x = SrcPntsp].x ; 
DstPnts[i].y = SrcPnts[i].y ; 

} 

mksegment(SrcPnts[1].x, SrcPnts[1].y. SrcPnts[2].x, SrcPnts[2].y,&seg2) ; 
mksegment(SrcPnts[3].x, SrcPnts[3].y, SrcPntsfOI.x, SrcPnts[0].y,&seg4) ; 

if ( get_point_on_segment(seg2, param, &(DstPnts[2])) == 0 ) return 0 ; 
get_point_on_segment(seg4, param, &(DstPnts[3])) ; 



return 1 ; 
} 

int PASCAL isectJines(LINE 11, LINE 12, RPOINT *p) 
{ 
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double x,y,w,eps ; 

X = l1.b-I2.c-I2.b'l1.c; 
y = I1.c*l2.a -I2.c*l1.a; 
w= I1.a*l2.b -I2.a*l1.b; 
eps = 0.0001 ; 

if(fabs(w) <= eps) 

retum(O); 
p->x = x / w; 
p->y = y / w; 
retum(1 ); 

} 

int PASCAL center_of_bounded_rect(RPOINT p1,RPOINTp2, RPOINTp3, 
RPOINT p4, 

RPOINT *Center,double *Xwidth,double *Ywidth) 

{ 

RPOINT DownComer.UpCorner ; 
RPOINT LeftComer.RightCorner ; 

if (p2.y>p1.y){ 

UpComer.x = p2.x ; 

UpComer.y = p2.y ; 
>eise{ 

UpComer.x = p1.x; 

UpComer.y = pl.y ; 

} 

if ( p3.y > p4.y ) { 

DownComer.x = p4.x ; 

DownComer.y = p4.y ; 
} else { 

DownComer.x = p3.x ; 

DownComer.y = p3.y ; 

} 

if ( pl.x > p4.x ) { 
LeftComer.x = p1 .x ; 
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LeftCorner.y = pl.y ; 
} else { 
LeftCorner.x = p4.x ; 
LeftCorner.y = p4.y ; 

} 

if ( p2.x > p3.x ) { 

RightCorner.x = p3.x ; 

RightCorner.y = p3.y ; 
} else { 

RightCorner.x = p2.x ; 

RightCorner.y = p2.y ; 

} 

"Xwidth = fabs(RightComer.x - LeftComer.x)/2.0 -2 ; 
"Ywidth = fabs(UpCorner.y - DownComer.y)/2.0 -2 ; 

Center->x = min(UpComer.x,DownComer.x)+fabs(UpComer.x- 
DownComer.x)/2.0 ; 

Center->y = min(UpComer.y,DownCorner.y)+fabs(UpComer.y- 
DownComer.y)/2.0 ; 



return 1 ; 

} 

// This function gives back the center of each tracking window in the prototype 
// and the width and height of each window in the transformed model. All 
// the information is in the Windows array. 

int PASCAL get_tracking_windows(RPOINT *Prot,RPOINT*Model t 

int From, int To,TR_WlN -Windows) 

{ 

double Xmax.Xmin ; 
double XModmax.XModmin ; 
double Xunit.XModunit ; 
double CurrX[20] ; 
RPOINT Cp1,Cp2,Cp3,Cp4 ; 
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RPOINT Cp[4] ; 
RPOINT Mo[4] ; 
int i ; 

LINE UpLine.DownLine ; 
LINE UpModLine.DownModLine ; 
RPOINT p1,p2,p3,p4; 
RPOINT 11101,0102,11103,0104 ; 
RPOINT DumCenterArrt20] ; 

p1 = ProtfO] ; 

p2 = Prot[1]; 

p3 = Prot[2] ; 

p4 = Prot[3] ; 

mo1 = ModelfO] ; 

mo2 = Model[1] ; 

mo3 = Model[2] ; 

mo4 = Model[3] ; 

Xmax = max(p1 .x,p4.x) ; 

Xmin = min(p2.x,p3.x) ; 

Xunit = (Xmin-Xmax)/(douple)(To-From) ; 

XModmax = max(mo1 .x,mo4.x) ; 

XModmin = min(mo2.x,mo3.x) ; 

XModunit = (XModmin-XModmax)/(double)(To-From) ; 
mkline(p1 .x,p1 .y,p2.x,p2.y,&UpLine) ; 
mkline(p3.x,p3.y,p4.x,p4.y,&DownLine) ; 
mkline(mo1 .x,mo1 .y,mo2.x,mo2.y,&UpModLine) ; 
mkline(mo3.x I mo3.y,mo4.x,mo4.y t &DownModLine) ; 

for ( i = From ; i < To-1 ; i++ ) { 
get_quad_segment_on_x(UpLine, DownLine,Xmax I Xunit l i,Cp) ; 
center_of_bounded_rect(Cp[0],Cp[1],Cp[2],Cp[3],&(Windows[i].Center), 

&(Windows[i].Xdir),&(Windows[i].Ydir)) ; 
get_quad_segment_on_x(UpModLine, 
DownModLine,XModmax,XModunit,i,Mo) ; 
center_of_bounded_rect(Mo[0] I Mo[1],Mo[2],Mo[3] I &(DumCenterArr[i]), 
&(Windows[i].Xdir),&(Windows[i].Ydir)) 

} 
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return 1 ; 

} 

// This function gets two horizontal (approx) lines, a start point on 
// X axis a unit and a number of segment, and returns in Vertexes the 
// vertexes of a rectangle in the number segment which is bounded inside 
// these two lines. 

int PASCAL get_quad_segment_on_x(LINE UpLine.LINE DownLine, double 
XStart, 

double Xunitjnt SegNum.RPOINT *Vertexes) 

{ 

double StartPoint.EndPoint ; 

StartPoint = XStart -»- XunifSegNum ; 
EndPoint = StartPoint + Xunit ; 

Vertexes[0].y = (Up!_ine.a*StartPoint + UpLine.c)/-UpLine.b ; 
Vertexes[0].x = StartPoint ; 

Vertexes[1].y - (UpLine-.a'EndPoint + UpLine.c)/-UpLine.b ; 
Vertexes[1].x = EndPoint ; 
Vertexes[2].x = EndPoint ; 

Vertexes[2].y = (DownLine.a*EndPoint + DownLine.c)/-DownLine.b ; 
Vertexes[3].x = StartPoint ; 

Vertexes[3].y = (DownLine.a*StartPoint + DownLine.c)/-DownLine.b ; 

return 1 ; 
} 
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#include <windows.h> 
#include <windowsx.h> 
#include <math.h> 
#include <commdlg.h> 
#include <stdlib.h> 
#include "const.h" 
#inc!ude "bitmap, h" 
#include "lines.h" 
#include "track.h" 
#include "persp.h" 
#include "min_mag.h" 
#include "lib.h" 

#define SIZE 8 

#defme X_AXIS 1 
#define Y_AXIS 2 
#define MAXIMAL 1 
#define MINIMAL 2 

static double Fa[2 * FSIZE + 1 ], *F; 

int PASCAL LSE_Perspective(HWND ,SHIFT_POINTS , SHIFT_POINTS 
,int, 

Perspective_Transform *) ; 
int PASCAL xPerspEqn(double , double , double , double *) ; 
int PASCAL yPerspEqn(double , double , double , double *) ; 
int PASCAL qrsolv8 (HWND .double m[SlZE][SIZE], int , double *) ; 
int PASCAL qrdecomp (double m[SIZE][SIZE], int , double *, double •) ; 
int PASCAL rsolv (double m[SIZEJ[SIZE], int , double *, double *) ; 
int PASCAL invertPerspective(double PfI3][3], double Pb[3][3]) ; 
int PASCAL xThinEqn(double, double, double, double *) ; 
int PASCAL yThinEqn(double, double, double, double *) ; 
double PASCAL det3(double y[3][3]) ; 
int PASCAL inv3(double y[3][3], double z[3][3]) ; 
int PASCAL tmSim(SHIFT_POINTS , SHIFT_POINTS , 
int,Perspective_Transforrn *, 
HFILE ) ; 

int .cded dcomp(const void "a, const void *b) ; 
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double . norm2(RPOINT a, RPOINT b) ; 

int PASCAL delete_exterme _point(SHIFT_POINTS ,SHIFT_POINTS . 
int , int ,int *); 

MYBITMAP FAR * minify(HWND hwnd.MYB ITMAP FAR* in, int fac) 
{ 

MYBITMAP FAR *aux, *out; 

r Build windowed-sinc filter-table 7 
sinc_filter(fac); 

r horizontally sub-sample in -> aux 7 
aux = hminify(hwnd, in, fac); 

/* vertically sub-sample Mid -> Out 7 
out = vminify(hwnd,aux, fac); 

bm_free(aux); 

retum(out); 

} 

MYBITMAP FAR *hminify(HWND hwnd,MYB ITMAP FAR • in, int fac) 
{ 

MYBITMAP FAR *out; 
int y, 

int OutCols; 
int ColorFactor ; 

OutCols = in->cols / fac ; 

out = bm_alloc(OutCols , in->rows, in->typ); 

if(out == NULL) 

retum(NULL); 
if ( in->typ == COLOR_MODEL ) ColorFactor = 3 ; 
else ColorFactor = 1 ; 
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out->gpic = (BYTE huge ") 

GlobalAilocPtr(GMEM_MOVEABLE,(DWORD)OutCols*(DWORD)(in- 

>rows)* 

(DWORD)ColorFactor); 

if(in->typ == GREY_MODEL) { 
for(y = 0; y < in->rows; y++) { 

lpf1D(BITMAP_PLACE_PTR(in.y,0), in->cols, fac, 

BUMAP_PLACE_PTR(out,y,0) ) ; 

} 

} 

else { // COLOR MODEL 

for(y = 0; y < in->rows; y++) { 

lpf1D_rgb(BITMAP_RGB_PLACE_PTR(in,y,0), in->cois, fac, 
BITMAP_RGB_PLACE_PTR(out I y,0) ) ; 

} 

} 

retum(out); 



MYBITMAP FAR *vminify(HWND hwnd, M YB ITMAP FAR *in, int fac) 
{ 

MYBITMAP FAR *out; 
int y, x; 

BYTE huge *ivec; 
BYTE huge *ovec; 
int OutRows ; 
int ColorFactor; 

OutRows = in->rows / fac ; 

out = bm_alloc(in->cols, OutRows , in->typ); 

if(out == NULL) 

return(NULL); 
if ( in->typ == COLOR_MODEL ) ColorFactor = 3 ; 
else ColorFactor = 1 ; 
out->gpic = (BYTE huge *) 
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GlobalAllocPtr(GMEM_MOVEABLE,(DWORD)OutRows-(DWORD)(in->cols)* 

(DWORD)ColorFactor); 
ivec = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,(DWORD)(in- 
>rows)* 

(DWORD)ColorFactor); 
ovec = (BYTE huge -)G!obalAllocPtr(GMEM_MOVEABLE,(DWORD)(out- 
>rows)* 

(DWORD)ColorFactor); 

if(in->typ == GREY_MODEL) { 
for(x = 0; x < in->cols; x++) { 
for(y = 0; y < in->rows; y++) 

ivec[y] = BITMAP_PLACE(in,y,x) ; 
Ipfl D(ivec, in->rows, fac, ovec); 
for(y = 0; y < out->rows; y++) 

BITMAP_PLACE(out,y,x) = ovec[y]; 

} 

} 

else { 

for(x = 0; x < in->cols; x++) { 
for(y = 0; y < in->rows; y++) { 

ivec[(DWORD)3*(DWORD)y] = 
*( B ITM AP_RG B_P LAC E_PTR( i n , y , x) ) ; 

ivec[(DWORD)3*(DWORD)y+1] = 
*((BITMAP_RGB_PLACE_PTR(in,y,x))+1 ) ; 

ivec[(DWORD)3*(DWORD)y+2] = 
*((B!TMAP_RGB_PLACE_PTR(in,y,x))+2) ; 
} 

Ipfl D_rgb( ivec, in->rows, fac, ovec); 
for(y = 0; y < out->rows; y++) { 

*(BITMAP_RGB_PLACE_PTR(out,y,x)) = 
ovec[(DWORD)3-(DWORD)y]; 

-((BITMAP_RGB_PLACE_PTR(out t y,x))+1) = 

ovec[(DWORD)3*(DWORD)y+1]; 
•((BITMAP_RGB_PLACE_PTR(out,y,x))+2) = 

ovec[(DWORD)3*(DWORD)y+2]; 

} 
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} 

retum(out); 

} 



int PASCAL sinc_filter(int fac) 
{ 

int j; 

int fsize = LOBES * fac; 
double pie = acos(-1.0); 
double sum; 

F = Fa + fsize; 

for(j = -fsize; j <= fsize; j++) { 

FQ] = 1.0/ (double)(2 * fsize + 1 ); 

} 

r Compute windowed sine filter table */ 
for(j = -fsize; j <= fsize; ]++) { 

double x = (double)j / fac; 

double z, w; 

if(j==0){ 
z= 1.0; 

} 

else { 

z = sin(pie *x)/(pie *x); 

} 

w = 0.5 + 0.5 * cos(pie * (double)j / (double)fsize); 
F[j] = z * w; 

} 

F Normalize to unit integral */ 
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for(sum = 0, j = -fsize; j <= fsize; j++) 

sum += F[j]; 
for(j = -fsize; j <= fsize; j++) 

F[j] /= sum; 
return 1 ; 

} 

int PASCAL Ipf1 D(BYTE huge* in, int Dim, int fac, BYTE huge *out) 
{ 

int i, j, k,x; 

int dim = Dim /fac; 

double acc ; 

for(k = i = 0; i < dim; k += fac, i++) { 

acc = 0.0; 

forC = -2 * fac; j <= 2 * fac; { 

x= k +j; 

T zero padding *1 
if(x >= 0 && x < Dim) 

acc += (double)(*(in+x))* F[fl; 

} 

if(acc < 0.0) 

*(out+i) = 0; 
eise if(acc > 255.0) 

•(out+i) = 255; 

else 

*(out+i) = (BYTE)(0.5 + acc);; 

} 

return 1 ; 

} 

int PASCAL Ipf 1 D_rgb(BYTE huge* in. int Dim, int fac, BYTE huge *out) 
{ 
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int i, j, k,x; 
int dim = Dim / fac; 
double accr, accg, accb ; 
DWORD CurrPI ; 

for(k = i = 0; i < dim; k += fac, i++) { 

accr = accg = accb = 0.0; 

for(j = -2 * fac; j <= 2 * fac; { 

x = k + j; 

/* zero padding */ 
if(x >= 0 && x < Dim) { 

accr += (double)(*(in+((DWORD)3*(DWORD)x)))* FQ]; 
accg += (double)(*(in+((DWORD)3*(DWORD)x+1)))* Fffl; 
accb += (double)(*(in+((DWORD)3*(DWORD)x+2)))* F[j]; 

} 

} 

CurrPI = (DWORD)3*(DWORD)i ; 
if (accr < 0.0) 

*(out+CurrPI) = 0; 
else if(accr > 255.0) 

-(out+CurrPI) = 255; 

else 

*(out+CurrPI) = (BYTE)(0.5 + accr);; 

CurrPI = (DWORD)3*(DWORD)i+1 ; 
if(accg < 0.0) 

*(out+CurrPI) = 0; 
else *rf(accg > 255.0) 

*(out+CurrPI) = 255; 

else 

*(out+CurrPI) = (BYTE)(0.5 + accg); 

CurrPI = (DWORD)3*(DWORD)i+2 ; 
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if(accb < 0.0) 

*(out+CurrP!) = 0; 
else if(accb > 255.0) 

-(out+CurrPI) = 255; 

else 

♦(out+CurrPI) = (BYTE)(0.5 + accb);; 

} 

return 1 ; 

} 

int PASCAL edge_refine(MYBITMAP "Bmap.EDGE *e,int Len) 
{ 

double dx ; 
double dy ; 
int status; 

dx = fabs(e->xe - e->xs); 
dy = fabs(e->ye - e->ys); 

if(dx<dy) 

e->vertical = 1; 
else 

e->vertical = 0; 

if(e->vertical) { 

r horizontal search for max. gradient 7 
if(status = h_ref«ne(Bmap,&(e->xs) 1 &(e->ys).Len)) return(status); 
if(status = h_refine(Bmap,&(e->xe), &(e->ye),Len)) return(status); 

} 

else { 

r vertical search for max. gradient 7 
if(status = v_refine(Bmap,&(e->xs), &(e->ys),Len)) return(status); 
if(status = v_ref.ne(Bmap,&(e->xe), &(e->ye),Len)) retum(status); 

} 

return (0); 

} 
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int PASCAL sub_pixel_interp(double ep, double ec, double en, double *zm, 

double "em) 

{ 

/* 1D sup-pixel estimation of the registration error minimum: 

* ep = A (-1 ) A 2 + B(-1) + C= A- B + C 
*ec = A(0) A 2 + B(0) + C= C 

- en = A (+1 ) A 2 + B (+1) + C = A + B. + C 

* yields the following solution: 
7 

double C = ec; 

double A = (ep + en) / 2.0 - C; 
double B = (en - ep) / 2.0; 
double z; 

r sup-pixel poistion estimate is zm 7 
z = < zm = -(B/(2.0*A)); 
//*em = z*(A*z +B) +C ; 
*em = A • z * z + B * z + C; 

retum(O); 

} 



#defme EMAX 1 0OO00OOL 

#define R0 14 /* search range 7 

#define RY 6 f Search range in Y direction7 

double Exy[2*RY+1 ][2"R0+1 ] ; 

HFILE hFile ; 

OFSTRUCTof; 

int PASCAL xysolve(HWND hwnd , M YB UMAP *CurrBmap,MYBITMAP 
*DestBmap, 

SHIFT *Shifts,TR_WIN *Windows,int WindowsNum, 
TRACK_POINTS TrBase TRAC K_P O I NTS TrPoints, 
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Perspective_Transform "NewTransf, HFILE hFiie, 
TRACK_POINTS* DBasep.RPOINT *DiffArr) 

{ 

int k, num; 
SHIFT i; 
char String[50] ; 
int Wr = 0 ; 
int j ; 

double HalfX,HalfY ; 
SHIFT_POINTS InitPos, NewPos ; 
RPOINT ShiftVals[NUM_OF_TRACK_POINTS] ; 
int lndexes[NUM_OF_TRACK_POINTS] ; 
int Size, Counter ; 
int Remlndex ; 

for ( k = 0 ; k < NUM_OF_TRACK_POINTS 
Shifts[k].dx = Shifts[k].dy = Shifts[k].sim 

} 

k = 0; 

Counter = 0 ; 

for(k = 0 ; k < TrPoints->NumOfPoints; k++) { 
//for(k = 0 ; k < WindowsNum; k++) { 

if ( xysrch(hwnd,CurrBmap I DestBmap,&(Shifts[k]), 
TrBase->TrackP[k],TrPoints->TrackP[k], 

//(int)(Windows[k].Xdir),(int)(Windows[k]. Ydir). 1 0,4) != 0 ) { 
CORR_W!NDOWX,C0RR_WINDO\AA' i rR0,RY-/10,5) != 0 ) 

{ 

ShiftVals[Counter].x = Shifts[k].dx ; 
ShiftVals[Counter].y = Shifts[k].dy ; 
lndexes[Counter] = k ; 
Counter++ ; 

} 

} 

for ( k = 0 ; k < Counter ; k++ ) { 

//lnitPos.TrackP[k].x = (double)DBasep->TrackP[lndexes[k]].x ; // 

Replacing clustering. 
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//lnitPos.TrackP[k].y = (double)DBasep->TrackP[lndexes[k]].y ; // 
Replacing clustering. 

lnitPos.TrackP[k].x = (double)TrBase->TrackP[lndexes[k]].x ; // 
Replacing clustering. 

lnitPos.TrackP[k].y = (double)TrBase->TrackP[lndexes[k]].y ; // 
Replacing clustering. 

^ NewPos.TrackP[k].x = TrPoints->TrackP[lndexes[k]].x + 

ShiftVals[k].x - DiffArr[lndexes[k]].x; // Replacing clustering. 
NewPos.TrackP[k].y = TrPoints->TrackP[lndexes[k]].y + 

ShiftVals[k].y -DiffArr[lndexes[k]].y; // Replacing clustering. 

} 

Size = Counter ; // Replacing clustering. 



strcpy(String,"lnitPos After Clusterin") ; // 

_lwrite(hFile, String, strlen(String)) ; // 

for ( k = 0 ; k < Size ; k++ ) { // 
sprintf(String 1 "%lf,%lf\n",lnitPos.TrackP[k].x,lnitPos.TrackP[k].y);// 

Jwrite(hFile,String,strlen(String)) ; // 

} II 

strcpy(String,"\n\nNewPos After Clustertn") ; // 

_iwrite(hFile, String, strlen(String)) ; II 

for ( k = 0 ; k < Size ; k++ ) { // 
sprintf(String,"%lf I %lf\n",NewPos.TrackP[k].x,NewPos.TrackP[k].y); // 

_iwrite(hFiie, String, strlen(String)) ; // 

} // 
_lwrite(hFile,"\n\n\n ,, ,3) ; 
// Removing 20 % Of Bad Points 

r 

delete_exterme_point(lnitPos,NewPos, Size, X_AXIS ,&Remlndex) ; 
for ( j = Remlndex ; j < Size-1 ; j++ ) { 

InitPos.TrackPQ] = lnitPos.TrackPD+1] ; 

NewPos.TrackPO] = NewPos.TrackPQ+1] ; 

} 

Size-; 

delete_exterme_point(lnitPos,NewPos, Size, Y_AXIS ,&Remlndex) ; 
for ( j = Remlndex ; j < Size-1 ; j++ ) { 

InitPos.TrackPD] = lnitPos.TrackPD+1] ; 
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NewPos.TrackPQ] = NewPos.TrackP[j+1] ; 

} 

Size- ; 
*/ 

if ( get_in_series_flag() == 1 ) { 

tmSim(lnitPos, NewPos, Size.NewTransf.hFile) ; 

} else { 

tmSim(lnitPos, NewPos, Size.NewTransf.hFile) ; 
//LSE_Perspective(hwnd,lnitPos,NewPos,Size I NewTransf) ; 

} 

for ( k = 0 ; k < Size ; k++ ) { 
double DstX.DstY.w ; 

DstX = lnitPos.TrackP[k].x * NewTransf->Pf[0][0] + 

lnitPos.TrackP[k].y * NewTransf->Pf[1 ][0] + NewTransf- 

>Pf[2][0]; 

DstY = lnitPos.TrackP[k].x * NewTransf->Pf[0][1] + 

lnitPos.TrackP[k].y - NewTransf->Pf[1 ][1 ] + NewTransf- 

>Pf[2][1] ; 

w = lnitPos.TrackP[k].x * NewTransf->Pf[0][2] * 

lnitPos.TrackP[k].y * NewTransf->Pf[1][2] + NewTransf- 

>Pf[2][2] ; 

sprintf(String; , %lf->%lf:::%lf-> 0 /olfvn' , .lnitPos.TrackP[k].x.DstXM I 

lnitPos.TrackP[k].y,DstYyw) ; 
Jwrite(hFile,String,strlen(String)); 

} 

for(j = 0;j<3;j++){ 11 
sprintf(String,"Vi%!f I %lf. %lf\n",NewTransf->Pf[j][0], // 
NewTransf->PfO][1 ], NewTransf->PfD][2]) ; // 
lwrite(hFile,String,strlen(String)) ; 11 

f 

retum(1 ); 

} 



int PASCAL xysrch(HWND hwnd.MYBlTMAP •CurrBmap.MYBITMAP 
"OriginSign. 
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SHIFT *s. POINT pBase, POINT pLast.int CorWinX.int CorWinY.int XWin, int 
YWin) 
{ 

int x_0, y_0; 
int dx, dy, k, I; 
int x_n,y_n ; 
int dj, di; 
double t,r ; 
int i ; 

double em; double e ; 
char String[50] ; 
int long PixInWin ; 
char Buffer[256] ; 
long Tresh ; 
BYTE huge *CurrPtr ; 
BYTE huge "ZeroPtr ; 
int FromX, FromY ; 
double z, d , area; 



x_0 = pBase.x; 
y_0 = pBase.y; 

FromX = pLast.x ; 
FromY = pLast.y ; 

PixInWin = (DWORD)(CorWinX*2+1)*(DWORD)(CorWinY-2+1) ; 
Tresh = (DWORD)12*(DWORD)PixlnWin ; 
//Tresh = (DWORD)4*(DWORD)PixlnWin ; 

area = (2 * CorWinY + 1 ) * (2 • CorWinX + 1 ); 
em = 1 .0e20; 
y_n = FromY -YWin -1 ; 
for(dy = -YWin; dy <= YWin; dy++) { 
y_n++ ; 

for(dx = -XWin; dx <= XWin; dx++) { 
x_n = FromX +dx ; 
e = 0.0 ; 
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for(k = -CorWinY; k <= CorWinY; k++) { 

CurrPtr = BITMAP_PLACE_PTR(CurrBmap,y_n+k,x_n) ; 

ZeroPtr = BITMAP_PLACE_PTR(OriginSign,y_0+k,x_0) ; 
for(l = -CorWinX; I <= CorWinX; I++) { 

z = CurrPtrfl] - ZeroPtr[l] ; 
e = e + z * z; 
} 

} 

e /= area; 
Exy[dy+YWin][dx+XWin] = e; 

T update min. error */ 
if(e < em) { 

em = e; 

dj= dx; 

di = dy; 

} 

} 

} 

s->dx = dj ; 
s->dy = di ; 

if ( em > Tresh ) return 0 ; 

if ( abs(dj) == XWin [| abs(di) == YWin ) return 0 ; 

sub_pixel_refine(dj,di,dj+XWin, di+YWin, s); 

return 1 ; 

} 

int PASCAL sub _pixel_refine(int dj, int di, int dxlndex,int dylndex,SHIFT *s) 
{ 

double deltax, deltay; 
double simx, simy; 

s->dx = dj; 
s->dy = di; 

s->sim = Exy[dylndex][dxlndex]; 
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sub_pixel_interp(Exy[dylndex][dxlndex-1 ], Exy[dy lndex][dxlndex], 

Exy[dylndex][dxlndex+1], &deltax, &simx); 

sub_pixel_interp(Exy[dylndex-1 ][dxlndex], Exy[dylndex][dxlndex], 

Exy[dylndex+1][dxlndex], &deltay, &simy); 

s->dx += deltax; 
s->dy += deltay; 

s->sim = (simx + simy) / 2.0; 

return(O); 

} 



static double Mp[8][8], Ap[8]; 
double G[2 * NUM_OF_TRACK__POINTS][8]; 
double Gt[8][2 * NUM_OF_TRACK_POINTS]; 
double Fpr[2 * NUM_OF_TRACK_POINTS]; 



int PASCAL Quad2Quad(HWND hwnd.RPOINT srcpnts[4],RPOINT 
dstpnts[4], 

Perspective_Transform Tp) 

{ 

int i,j, k, status; 
double x,y,u,v ; 



for(k = 0; k < 4; k++) { 
x = dstpnts[k].x; 
y = dstpnts[k].y; 
u = srcpnts[k].x; 
v = srcpnts[k].y; 

Ap[ k] = x; 
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Ap[4 + k] = y; 

xPerspEqn(x. u, v, Mp[ k]); 
yPerspEqn(y, u, v, Mp[4 + k]); 

} 

qrsolv8(hwnd, Mp, 8, Ap); 

Tp->Pf[0][0] = Ap[0]; 
Tp->Pfl1][0] = Ap[1]; 
Tp->Pfl21[0] = Ap[2J; 
Tp->Pf[0][1] = Ap[3]; 
Tp->Pf[1][1] = Ap[4]; 
Tp->PfI2][1] = Ap[5]; 
Tp->Pf[0][2] = Ap[6]; 
Tp->Pf[1][2] = Ap[7]; 
Tp->Pf[2][2] = 1-0; 

status = invertPerspective(Tp->Pf, Tp->Pb); 
return(1); 

} 

int PASCAL copy_transform(Perspective_Transform 

*To t Perspective_Transform *From) 

{ 

int ij ; 

for ( i = 0 ; i < 3 ; i++ ) { 
for(j = 0;j<3 ;j++){ 
To->Pfpl03 = From->Pf[ilDl ; 
To->Pb[i]Q] = From->Pb[i]Dl ; 

} 

} 

return 1 ; 
} 
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int PASCAL LSE_Perspective(HWND hwnd,SHIFT_POINTS src_pts, 
SHIFT_POINTS dst_pts, int pnum,Perspective_Transform *Tp) 

{ 

int i,j, k, status; 
double x,y,u,v ; 

if(pnum < 4) { 

MessageBox (hwnd, "Cannot solve perspective with less than 3 
points." 

, "Shifts", MBJCONEXCLAMATION | MB_OK) ; 
return 0 ; 

} 

if(pnum == 4) { /* Quad2Quad */ 
for(k = 0; k < 4; k++) { 

x = dst_pts.TrackP[k].x; 
y = dst_pts.TrackP[k].y; 
u = src_pts.TrackP[k].x; 
v = src_pts.TrackP[k].y; 

Ap[ k] = x; 
Ap[4 + k] = y; 

xPerspEqn(x, u, v, Mp[ k]); 
yPerspEqn(y, u, v, Mp[4 + k]); 

} 

} 

else { 

for(k = 0; k < pnum; k++) { 
x = dst_pts.TrackP[k].x; 
y = dst_pts.TrackP[k].y; 
u = src_pts.TrackP[k].x; 
v = src_pts.TrackP[k].y; 

Fpr[ k] = x; 
Fpr[pnum + k] = y; 
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xPerspEqn(x, u. v, G[k]); 
yPerspEqn(y, u, v, G[pnum + k]); 

} 

for(k = 0; k < 2 * pnum; k++) { 
forG = 0; j < 8; j++) { 
GtQ][k] = G[k]fj]; 

} 

} 

for (i = 0; i < 8; i++) { 
for (j = 0; j < 8; { 
Mp[i]0] = 0-0; 

for (k = 0; k < 2 * pnum; k++) { 
MpplDl + = Gt[i][k] * G[k]D]; 

} 

} 

} 

forG = 0; j < 8; j++) { 
ApO] = 0; 

for(k = 0; k < pnum * 2; k++) { 
Ap[j] += GtQ][k] * Fpr[k]; 

} 

} 

} 

qrsolv8(h>vnd, Mp, 8, Ap); 

Tp->Pfl01[0] = Ap[0]; 
Tp->Pf[1][0] = Ap[1]; 
Tp->Pf[2][0] = Ap[2]; 
Tp->PflO][1] = Ap[3]; 
Tp->Pf[U[1] = Ap[4]; 
Tp->Pf[2][1] = Ap[5]; 
Tp->PflO][2] = Ap[6]; 
Tp->Pfl1K2] = Ap[7]: 
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Tp->PfI2][2] = 1.0; 

status = invertPerspective(Tp->Pf. Tp->Pb); 
return(1); 

} 

int PASCAL xPerspEqn(double x, double u, double v, double *xRow) 



{ 



xRow[0] = 


u; 


xRow[1] = 


v; 


xRow[2] = 


1; 


xRow[3] = 


0; 


xRow[4] = 


0; 


xRow[5] = 


0; 


xRow[6] = 


- u * x; 


xRow[7] = 


- v * x; 



} 



int PASCAL yPerspEqn(double y, double u, double v, double *yRow) 



{ 



yRow[0] = 


0 




yRow[1] = 


0 




yRow[2] = 


0 




yRow[3] = 


u 




yRow[4] = 


V 




yRow[5] = 


1 




yRow[6] = 




u*y; 


yRow[7] = 




v "y; 



} 



int PASCAL qrsolv8 (HWND hwnd, double m[SIZE][S!ZE], int size, double 

b[SIZE]) 

{ 

int i, 

j; 
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double tau, 
m1[SIZE], 
m2[SIZE]; 

if (qrdecomp (m, size, ml , nr>2) < 0) { 

MessageBox (hwnd, "singularity in qrdecomp()." 

"Shifts", MBJCONEXCLAMATION | MB_OK) ; 
return 0 ; 

• } 

for G = 0; j < (size - 1 ); j++) { 
tau = 0.0; 

for (i = j; i < size; i++) 

tau += m[i]D*] * b[i]; 
tau/=m1[j]; 
for (i = j; i < size; i++) 

b[i] -= tau * rn[i]D]; 

} 

b[size-1]/= m2[size-1]; 
rsolv (m, size, m2, b); 

} 

r 

Compute the QR decomposition of a square matrix m using the 
Stewart 

* algorithm. 

Upon termination , thr decomposition is stored in m,m1 and m2 
follows: 

R is contained in the upper triangle of m except that its main 
diagonal is contained in m2, and Q(transpos)=Q(n-1 )*.. *Q(1 ) 
where QG)=l-(Uj*Uj(transpos)/Pj) where 
Ujp]=0. i=1->j-1, UjIil=m[iiDl.i=i-*n, Pj*m1[fl. 

Stewart,G.W., Introduction to matrix Computations , Academic F 
New York (1973). 

* C Implementaion: Dr. I. Wilf. 
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int PASCAL qrdecomp (double m[S!ZE][SIZE]. int size, double m1[S!ZE], 

double m2[SlZE]) 

{ 

int i,k,j ; 

double eta,t,sigma,tau ; 



for (k = 0;k<(size-1); k++) { 
eta = 0.0; 

for (i = k; i < size; i++) 
if (fabs (m[i][k]) > eta) 
eta = fabs (m[i][k]); 
if (eta ==0.0) 
return (-1 ); 
r form Qk and premultiply m by it 7 
t = 0; 

for (i = k; i < size; i++) { 
mp][k] /= eta; 
t+= m[i][k]*m[i][k]; 

} 

«f(m[k][k] >= 0.0) 

sigma = sqrt(t); 

else 

sigma = -sqrt(t); 

m[k][k] += sigma; 

m1[k] = sigma *m[k][k]; 
m2[k] = (-eta * sigma); 
tau = 0; 

for G = k + 1;j< size; j++) { 
tau = 0; 

for (i = k; i < size; i++) 

tau += m[i][k] * m[i]ffl; 

tau/=m1[k]; 

for (i = k; i < size; i++) 

m[i]D] -= tau * m[i][k]; 

} 

} 

m2[size - 1] = m[size - 1][size - 1]; 
return (0); 
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} 

r 

rsolv(m,size,m2,b) 

solve Rx=b for b, where the upper triangular matrix R is 
* stored in M , m2. 

- C Implementaion: Dr. I. Wilf. 
*/ 

int PASCAL rsoiv (double m[SIZE][S!ZE], int size, double *m2, 
{ 

int ij; 
double s; 



for (i = size - 2; i >= 0; i-) { 
s = 0; 

forG = i + 1; j<size;j++) 

s += m[i]D] * bQ]; 
b[i] = (b[i] - s) / m2[i]; 

} 

} 

int PASCAL invertPerspective(double Pf[3l[3], double Pb[3][3]) 



double a1 1 = Pfl0][0]; 
double a12 = Pf[0][l]; 
double a1 3 = Pf[0l[2]; 
double a21 = Pf[l][0]; 
double a22 = Pf[1l[1]; 
double a23 = PfI1][2]; 
double a31 = PfI2][0]; 
double a32 = PfI2][1]; 
double a33 = Pf[2][2]; 

Pb[0][0] = a22 * a33 - a23 * a32 
Pb[0][1] = a13 * a32 - a12 * a33 
Pb[0][2] = a12 * a23 - a13 * a22 
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Pb[1][0] = a23 


- a3l 


-a21 


* a33 


Pb[1][1] = a" 11 




- a13 


" a31 


Pb[1][2] = a13 


-a21 


-a11 


- a23 


Pb[2][0] = a21 


* a32 


- a22 


* a31 


Pb[2][1] = a12 


*a31 


-a11 


-a32 


Pb[2][2] = a11 


*a22 


-a12 


* a21 


inv3(Pf, Pb); 








retum(O); 









int PASCAL inv3(double y[3][3], double z[3][3]) 
{ 

double b[2][2],dety,detb; 
inti,j I k,l I k1,H; 

dety=det3(y); 
if(dety==0.0) return(1); 

r compute Q .*/ 
for(i=0;i< 3;i++) 
forG=0;j< 3;j++) { 
for(k = 0; k < 2; k++) 
for(l = 0; I < 2; !++) { 

if(l<i) 11=1; 

else 11=1+1; 

if(k<j) k1=k; 

else k1=k+1; 

b[k][l]=y[k1][MJ; 

} 

detb=b[0][0]*b[1][1]-b[1][0]*b[0][1]; 
if(((i+j)%2)==0) z[nO}=detb/dety; 
else z[i]ffl=(-detb)/dety; 

} 

} 

double PASCAL det3(double y[3][3]) 
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{ 

short j,k,l; 

double b[2][2],det,detb; 

det=0.0; 

forO=0;j<=2;j++) 

{ 

for(k=0;k<=1 ;k++) 

for(l=0;l<=1;l++) 

{ 

if(Kj)b[k][l]=y[k+1][l]; 
else b[k][l]=y[k+1][l+1]; 
} 

detb=b[0][0]*b[1 ][1 ]-b[0][1 ]*b[1 ][0]; 
|f(G%2)==0) det=det+y[0]DTdetb; 
else det=det-y[0]D]*detb; 
} 

return(det); 

} 

r 

int PASCAL invertPerspectiye(double PfI3][3], double Pb[3][3]) 
{ 

double 311,312,313,321,322,323,331,332,333 ; 



a11 =PflO][0]; 
a12 = Pf[0][1]; 
a13 = Pf[0][2]; 
a21 = PfI1][0]; 
a22 = PfI1][1]; 
a23 = PfI1][2]; 
a31 = Pf[2][0]; 
a32 = Pf[2][1]; 
a33 = Pf[2][2]; 



Pb[0][0] = a22 * a33 - a23 * a32; 
Pb[0][1 ] = a1 3 * a32 - a1 2 * a33; 
Pb[0][2] = a1 2 * a23 - a1 3 * a22; 
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Pb[1][0] = a23 * a31 - a21 * a33; 
Pb[1][1] = a11 *a33-a13*a31; 
Pb[1][2] = a13 *a21 -a11 * a23; 
Pb[2][0] = a21 * a32 - a22 • a31 ; 
Pb[2][1 ] = a1 2 ' a31 - a1 1 * a32; 
Pb[2][2] = a1 1 * a22 - a12 * a21 ; 

retum(O); 

} 
*/ 
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int PASCAL h_refine(MYBITMAP •Bmap, double *x, double y,\nt Len) 
{ 

int i, j, k, km; 
int z = Len + 1 ; 
double u, gm; 
double gmax; 
double a, b, c, d, e, f, 
double Rx, Gx, Bx; 
int rows.cols ; 
DWORD Size ; 
int EfectLen ; 
double *Gh ; 

i = (int)(*y + 0.5); 
j = (int)(*x + 0.5); 
cols = Bmap->co!s ; 
rows = Bmap->rows ; 

if<j < z || j > (cols - z)) return(1 ); 
if(i < 1 II i > (rows -2)) return(1); 

EfectLen = (DWORD)Len*(DWORD)2+1 ; 

Size = (DWORD)(sizeof(double))*(DWORD)Len-(DWORD)2+2 ; 

Gh = (double *)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 

for(k = -Len; k <= Len; k++) { 

a = *(BlTMAP_RGB_PLACE_PTR(Bmap,i-1,j+k-1)) ; 
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b = "(B ITMAP_RG B_P LACE_PTR( Bmap, i j+k-1 )) ; 
c = *(BlTMAP~RGB_PLACE_PTR(Bmap,i+1 j+k-1 )) ; 
d = *(BITMAP_RGB_PLACE_PTR(Bmap,i-1 j+k)) ; 
e = "( B ITMAP_RG B_P l_AC E_PTR( B map , i j+k)) ; 
f = *(BITMAP_RGB_PLACE_PTR(Bmap,i+1 j+k)) ; 

Rx = a + 2.0 ' b + c - d - 2.0 * e - f; 

a = *(B!TMAP_RGB_PLACE_PTR(Bmap,i-1 ,j+k-1 )+1 ) ; 
b = -(BITMAP_RGB_PLACE_PTR(Bmap,i.j+k-1)+1) ; 
c = *(BITMAP_RGB_PLACE_PTR(Bmap,i+1 j+k-1 )+1 ) ; 
d = *( B ITM AP_RG B_P LAC E_PTR(Bmap , i-1 j+k)+1 ) ; 
e = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j+k)+1) ; 
f = *(B!TMAP_RGB_PLACE_PTR(Bmap,i+1,j+k)+1) ; 
Gx = a + 2.0 * b + c - d - 2.0 * e - f; 

a = *(BITMAP_RGB_PLACE_PTR(Bmap,i-1 ,j+k-1 )+2) ; 
b = *(BITMAP_RGB_PLACE_PTR(Bmap,i,j+k-1)+2) ; 
c = *(BiTMAP_RGB_PLACE_PTR(Bmap,i+1 j+k-1 )+2) ; 
d = -(BITMAP_RGB_PLACE - PTR(Bmap,i-1,j+k)+2) ; 
e = -(BITMAP_RGB_PLACE_PTR(Bmap,i,j+k)+2) ; 
f = *(BITMAPrRGB_PLACE_PTR(Bmap,i+1 ,j+k)+2) ; 
Bx = a + 2.0*b + 'c-d-2.0*e-f; 

Gh[k+Len] = sqrt(Rx * Rx + Gx * Gx + Bx * Bx); 

> 

/* Find maximal response */ 
km = 0; 
gm = Gh[0]; 

for(k = 1 ; k < EfectLen; k++) { 
if(Gh[k] > gm) { 
km = k; 
gm = Gh[k]; 

} 

} 

if(km == 0 || km == EfectLen) { 
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GlobalFreePtr(Gh) ; 
return(1); 

} 

subj3ixel_interp(Gh[km-1], Gh[km], Gh[km+1], &u, &gmax); 

r can threshold gmax to decide if edge detection was successful 7 

GlobalFreePtr(Gh) ; 

if ( gmax < 100.0 ) return(1) ; 

*x += u+km; 

retum(O); 

} 

int PASCAL v_refi ne (M YB ITM AP *Bmap, double *x, double *y,int Len) 
{ 

int i, j, k, km; 
int 2= Len + 1; 
double v, gm; 
double gmax; 
int cols.rows ; 
DWORD Size; 
int EfectLen ; 
double a, b, c, d, e, f; 
double Ry, Gy, By; 
double *Gh ; 

i = (int)(-y + 0.5); 

j = (int)fx + 0.5); 

cols = Bmap->cols ; 

rows = Bmap->rows ; 

ifG < z H j > (cols - z)) return(1 ); 

if(i < 1 || i > (rows -2)) retum(1); 

EfectLen = (DWORD)Len*(DWORD)2+1 ; 

Size = (DWORD)(sizeof(double))*(DWORD)Len*(DWORD)2+2 ; 

Gh = (double *)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 

for(k = -Len; k <= Len; k++) { 

a = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1,j-1)) ; 
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b = "(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1 J)) ; 
c= *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1 j+1 )) ; 
d = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j-1)) ; 
e = *(BITMAP_RGB_PLACE_PTR(Bmap,i+kj)) ; 
f = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j+1)) ; 

Ry = a + 2.0 * b + c - d - 2.0 * e - f; 

a = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1 l j-1)+1) ; 
b = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1,j)+1) ; 
c= *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1,j+1)+1) ; 
d = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j-1)+1) ; 
e = *(BITMAP_RGB_PLACE_PTR{Bmap,i+k,j)+1) ; 
f = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j+1)+1) ; 



Gy = a + 2.0 * b + c - d - 2.0 * e - f, 

a = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1,j-1)+2) ; 
b = *(BITMAplRGB_PLACE_PTR(Bmap.i+k-1,j)+2) ; 
c = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k-1,j+i)+2) ; 
d = *(BITMAP_RGB_PLACE_PTR(Bmap,i+kj-1)+2) ; 
e = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j)+2) ; 
f = *(BITMAP_RGB_PLACE_PTR(Bmap,i+k,j+1)+2) ; 
By = a + 2.0 * b + c - d - 2.0 * e - f; 

Gh[k+Len] = sqrt(Ry * Ry + Gy * Gy + By * By); 

} 

r Find maximal response */ 
km = 0; 
gm = Gh[0]; 

for(k = 1; k < EfectLen; k++) { 
'rf(Gh[k] > gm) { 
km = k; 
gm = Gh[k]; 

} 

} 

•rf(km = 0 || km == EfectLen) { 
GlobalFreePtr(Gh) ; 
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return(1); 

} sub_pixel_interp(Gh[km-1], Gh[km], Gh[km+1], &v. &gmax); 

r can threshold gmax to decide if edge detection was successful 7 

GlobalFreePtr(Gh) ; 

if ( gmax < 100.0 ) return(1) ; 

*y += v+km; 

retum(O); 



#define ORDER 8 
#defme NDATA 20 

static double qrM[ORDER][ORDER], qrA[ORDER]; 

double qrG[2 * NDATA][ORDER]; 
double qrGt[ORDER][2 * NDATA]; 
double qrF[2 • NDATA]; 

int PASCAL Thin_Perspective(HWND hwnd, SHIFT.POINTS src_pts, 
SHIFT_POINTS dst_pts, int pnum, Perspecti've_Transforrn *Tp) 

{ 

int i, j, k, status; 
if (pnum < 3) { 

MessageBox (hwnd, "Cannot solve perspective with less than 3 
points." 

, "Shifts", MBJCONEXCLAMATION | MB_OK) ; 
return 0 ; 

} 

for(k = 0; k < pnum; k++) { 

double x = dst_pts.TrackP[k].x; 
double y = dst_pts.TrackP[k].y; 
double u = src_pts.TrackP[k].x; 
double v = src_pts.TrackP[k].y; 

qrF[ k] = x; 
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qrF[pnum + k] = y; 

xThinEqn(x, u, v, qrG[ k]); 
y ThinEqn(y, u, v, qrG[pnum + k]); 
continue; 

} 

for(k = 0; k < 2 * pnum; k++) { 
forG = 0; j < 5; { 
qrGt[j][k] = qrG[k]Q]; 

} 

} 

for(i = 0; i < 5; 
forG = 0; j < 5; j++) { 
' qrM[i]0] = 0.0; 
for(k = 0; k < 2 * pnum; k++) { 
qrM[i]D] += qrGt[i][k] * qrG[k]ffl; 

} 

} 

forG = 0; j < 5; j++) { 
. qrAO] = 0; 
for(k = 0; k < pnum * 2; k++) { 
qrAQ] += qrGt[j][k] • qrF[k]; 

} 

} 

qrsolv(qrM, 5, qrA); 

Tp->PfI0][O] = qrA[0]; 

Tp->Pfl1][0] = qrA[1]; 

Tp->Pf[2][0] = qrA[2]; 

Tp->Pf[0][1] = -qrA[1]; 

Tp->Pf[1][1]= qrAlO]; 

Tp->Pf[2]l1]= qrA[3]; 

Tp->Pf[0][21 = qrA[4J; 

Tp->Pf[1][2]= 0.0; 



SUBSTITUTE SHEET (RULE 26) 



WO 95/10919 



PCIYUS94/01679 



Tp->Pfl2][2] = 1.0; 

status = invertPerspective(Tp->Pf, Tp->Pb); 



return(1); 

} 



int PASCAL xThinEqn(double x, double u, double v, double *xRow) 
{ 

xRow[0] = u; 
xRow[1] = v; 
xRow[2] = 1 ; 
xRow[3] = 0; 
xRow[4] = - u * x; 
return 1 ; 



int PASCAL yThinEqn(double y, double u, double v, double *yRow) 
{ 

yRow[0] = v; 
yRow[1] - -u; 
yRow[2] = 0; 
yRow[3] = 1 ; 
yRow[4] = - u * y; 
return 1 ; 

} 

int PASCAL trans_grey_frame_to_fields(HWND hwnd.RPOINT 
*SrcPnts,RPOINT *DstPnts, 

MYBITMAP *SrcBmap,RPOINT*FrPnts 1 MYBITMAP *~F1 .MYBITMAP 

**F2) 
{ 

Perspective_Transform TpCurr.BasicTransf ; 
RPOINT FrDst[4],CmPoly[4J ; 
RECT Rectan ; 
MYBITMAP *DestBmap ; 
DWORD Size ; 
int Cols.Rows ; 
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Quad2Quad(hwnd,FrPnts,DstPnts,&TpCurr) ; 
|_find_bound_rect(DstPnts, &Rectan) ; 

l_quad_in_new_origin(CrnPo1y.DstPnts,Rectan.lett I Rectan.top,4) ; 

Cols = Rectan.right-Rectan.left+1 ; 

Rows = Rectan.bottom-Rectan.top+1 ; 

-F1 = bm_alloc(Cols,Rows,GREY_MODEL) ; 

Size = (DWORD)Cols*(DWORD)Rows ; 

(*F1)->gpic = (BYTE huge*)GlobalAllocPtr(GMEM_MOVEABLE,Size) ; 
perspective(hwnd,SrcBmap,*F1,FrPnts, 

CmPoly, GREY_MODEL, &BasicTransf) ; 

//split_bitmap_frame(SrcBmap,F1, F2) ; 
//bm_free(DestBmap) ; 

return 1 ; 
} 

#define NZOOM 256 
#defineWNUM 32 

double rZooms[NZOOM]; 

double rTheta[NZOOM]; 

double rDx[WNUM]; 

double rDyfWNUM]; 

double ValArr[] = {0.0, 0.0, 0.0, 0.0} ; 

double WheightD = {2.0,2.0,3.0,3.0} ; 

int PASCAL tmSim(SHIFT_POINTS mpts, SHIFT_POINTS fpts, int pnum, 
Perspective_Transform *Tp, HF1LE hFile) 

{ 

double zoom, theta; 
double zsin, zcos; 
char String[50] ; 
double dx, dy; 
double Orgtheta ; 

int i, j, nZoom = 0; 
double mien, flen ; 
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double mtheta, ftheta ; 

if(pnum > WNUM) 
pnum = WNUM; 



for(i = 0; i < pnum; i++) 
forQ = i + 1 ; j < pnum; j++) { 

mien = norm2(mpts.TrackP[i], mpts.TrackP[j]); 
if(mlen < 30.0) 
continue; 

flen = norm2(fpts.TrackP[i], fpts.TrackP[j]); 

mtheta = atan2(mpts.TrackP[j].x - mpts.TrackP[i].x, 

mpts.TrackP[j].y - mpts.TrackP[i].y); 

ftheta = atan2(fpts.TrackP|j].x -fpts.TrackP[i]-x, 

fpts.TrackPQ].y - fpts.TrackP[i].y); 

zoom = flen / mien; 
theta = ftheta - mtheta; 

if(nZoom < NZO0M) { 
rZooms[nZoom] = zoom; 
rTheta[nZoom] = theta; 
++nZoom; 

} 

} 

{ r Trimmed-mean estimate of theta */ 
double tavg = 0.0; 
int q1 = nZoom / 4; 
intq3 = 3~q1; 

qsort((void*)rTheta, (size__t)nZoom, sizeof(double), dcomp); 
for(i = q1 ; i < q3; 

tavg += rTheta[i]; 
tavg /= (double)(q3 - q1 ); 
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theta = tavg; 

} 

{ /* Trimmed-mean estimate of zoom */ 
double zavg = 0.0; 
int q1 = nZoom / 4: 
intq3 = 3 *q1; 

qsort((void w ) rZooms, (size_t) nZoom, sizeof(double), dcomp); 
for(i = q1 ; i < q3; i++) 

zavg += rZooms[i]; 
zavg /= (double)(q3 - q1 ); 
zoom = zavg; 

} 

//Orgtheta = theta ; 

//smooth_values(Orgtheta, &theta,ValArr,4,Wheight) ; 

sprintf(String,"\n%ZOOM %lf, THETA %lf\n" I zoom,theta) ; j 

Jwrite(hFiie,String,strlen(String)) ; 
zcos = zoom * cos(theta); 
zsin = zoom * stn(theta); 

for(i = 0; i < pnum; i++) { . 

rDx[i] = fpts.TrackP[i].x - zcos * mpts.TrackP[i].x - 
zsin * mpts.TrackP[i].y; 
rDy[i] = fpts.TrackP[i].y + zsin * mpts.TrackP[i].x - 
zcos " mpts.TrackP[i].y; 



{ r Trimmed-mean estimate of dx */ 
double xavg = 0.0; 
int q1 = pnum / 4; 
intq3 = 3*q1; 

qsort((void*)rDx, (size_t)pnum, sizeof(double), dcomp); 
for(i=.q1; i < q3; i++) 

xavg += rDx[i]; 
xavg/=(double)(q3-q1); 
dx = xavg; 
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{ r Trimmed-mean estimate of dy */ 
double yavg = 0.0; 
int q1 = pnum / 4; 
int q3 = 3 * q1; 

qsort((void*)rDy, (size_t)pnum, sizeof(double), dcomp); 
for(i = q1; i < q3; i++) 

yavg += rDy[i]; 
yavg /= (double)(q3 - q1); 
dy = yavg; 

} 

{T Fillfwd. matrix*/ 

Tp->Pf[0][0] = zcos; 
Tp->Pf[1][0] = zsin; 
Tp->Pf[2][0] = dx; 

Tp->Pf[0][1] = -zsin; 
Tp->Pf[1][1]=zcos; 
Tp->Pf[2][1] = dy; 

Tp->Pf[0][2] = 0; 
Tp->Pf[1][2] = 0; 
Tp->Pf[2][2] = 1; 

inv3(Tp->Pf, Tp->Pb); 

} 

retum(1); 

} 



double norm2(RPOINT a, RPOINT b) 
{ 

double dx = a.x - b.x; 
double dy = a.y - b.y; 
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return(sqrt(dx * dx + dy * dy)); 

} 

int _cdecl dcomp(const void *a, const void «b)r(double -a, double -fa)*/ 

{ if(-(double*)a = -(double*)b) retum(O); 
retumr(double-)a < *(double*)b ? -1 : 1 ); 

} 

int PASCAL delete_exter m e_point(SHIFT_POINTS init,SHIFT_POINTS new, 
int Size, int Axis.int *lndex) 

{ 

int i ; 

double Value.Tmp ; 

if(Axis = X_AX!S){ 
Value = -100.0; 
for ( i = 0 ; i < Size ; i++ ) { 

if ( (Tmp = fabs(new.TrackP[i].x - inft.TrackP[i].x)) > Value ) { 
Value = Tmp ; 
*lndex=i; 

} 

} 

} 

if (Axis = Y_AXIS ) { 
Value = -100.0; 
for ( i = 0 ; i < Size ; i++ ) { 

if ( (Tmp = fabs(new.TrackP[i].y - initTrackP[i].y)) > Value ) { 
Value = Tmp ; 
"Index - i ; 

} 

} 

} 

return 1 ; 
} 
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2 CLAIMS 

3 

4 

5 1. Apparatus for advertisement site detection 

6 comprising: 

7 a field grabber operative to grab and 

8 digitize at least one field representing at least a 

9 portion of a sports facility; and 

10 an advertisement site detector operative to 

11 detect at least one advertisement site in at least one 

12 field on a basis other than location of the 

13 advertisement site relative to the sports facility. 
14 

15 2. Apparatus for advertisement incorporation 

16 comprising: 

17 a field grabber operative to grab and 

18 digitize at least one field representing at least a 

19 portion of a sports facility; and 

20 an advertisement incorporator operative to 

21 incorporate a portion of an advertisement into at least 

22 one fiefd at a partially occluded advertisement site 

23 within the sports facility, wherein the portion of the 

24 incorporated advertisement corresponds to an unoccluded 

25 portion of the advertisement site. 
26 

27 3. Apparatus according to claim 2 wherein said 

28 advertisement incorporator includes an advertisement 

29 site detector operative to detect at least one 

30 advertisement site in at least one field on a basis 

31 other than location of the advertisement site relative 

32 to the sports facility. 
33 

34 4. Apparatus for advertisement site detection 

35 comprising: 

36 a field grabber operative to grab and 

37 digitize at least one field representing at least a 

38 portion of a sports facility; 

V09 
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2 an advertisement site detector operative to 

3 detect at least one advertisement site in at least one 

4 field; and 

5 an advertisement site tracker operative to 

6 track at least one advertisement site detected by the 

7 advertisement site detector without tracking an entire 

8 field. 
9 

10 5. Apparatus according to claim 2 wherein said 

11 advertisement incorporator includes: 

12 an advertisement site detector operative to 

13 detect at least one advertisement site in at least one 

14 field; and 

15 an advertisement site tracker operative to 

16 track at least one advertisement site detected by the 

17 advertisement site detector without tracking an entire 

18 field. 
19 

20 6. Apparatus according to claim 4 or claim 5 

21 wherein said advertisement site detector is operative 

22 to detect at least one advertisement site in at least 

23 one field on a basis other than location of the 

24 advertisement site relative to the sports facility . 
25 

26 7. A method for broadcasting advertisements 

27 comprising: 

28 broadcasting an image of an event including 

29 at least one advertisement image; 

30 identifying the advertisement image within 

31 the image of the event and enhancing only the 

32 advertisement image. 
33 

34 8. A method according to claim 7 wherein the 

35 step of enhancing comprises the step of sharpening the 

36 edges of the advertisement image. 
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2 9. A video processing method comprising: 

3 detecting a moving object in a video sequence 

4 including a plurality of video frames; and 

5 attaching an advertisement to the moving 

6 object in each of the plurality of the video frames. 
7 

8 <r 

9 io. Apparatus for advertisement image detection 

10 comprising: 

11 a field grabber operative to grab and 

12 digitize at least one field representing at least a 

13 portion of a sports facility; 

14 an advertisement image detector operative to 

15 detect at least one advertisement image in at least one 

16 field; and 

17 an advertisement exposure time counter 

18 operative to count the length of the exposure time 

19 period of each advertisement image. 
20 

21 11. Apparatus according to claim 10 wherein said 

22 time counter is also operative to store at least one 

23 characteristic of the exposure time period of each 

24 advertisement image other than its length, the 

25 apparatus also comprising an advertisement fee computer 

26 operative to compute an advertisement fee according to 

27 the length of the exposure time period and at least one 

28 other characteristic of the exposure time period. 
29 

30 12. Apparatus according to claim 11 wherein the 

31 characteristic of the exposure time period other than 

32 the length thereof includes an indication of whether or 

33 not the exposure time period took place during 

34 overtime. 
35 

36 13. Apparatus according to claim 11 wherein the 

37 characteristic of the exposure time period other than 

38 the length thereof includes an indication of the 
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1 interval between each . exposure and the beginning of the 

2 game . 
3 

4 i4. Apparatus according to claim 11 wherein the 

5 characteristic of the exposure time period other than 

6 the length thereof includes an indication of temporal 

7 proximity to a significant event. 
8 

9 is. Apparatus for incorporation of an audio 

10 advertisement into an audio channel • representing a 

11 sports event, the apparatus comprising: 

12 an audio advertisement memory operative to 

13 store an audio advertisement; and 

14 an audio mixer operative to mix the audio 

15 advertisement into an audio channel representing the 

16 sports event. 
17 

18 16. Apparatus according to claim 15 and also 

19 comprising: 

20 a field grabber operative to grab and 

21 digitize at least one field representing at least a 

22 portion '"of the sports facility at which the sports 

23 event is taking place; and 

24 a visual cue detector operative to detect a 

25 visual cue in at least one field and to control 

26 operation of the audio mixer in accordance with the 

27 visual cue. 
28 

29 17. Apparatus according to claim 16 wherein the 

30 visual cue comprises an advertisement image 

31 corresponding to the audio advertisement. 
32 

33 is. Apparatus for advertisement site detection 

34 comprising: 

35 an advertisement image memory storing an 

36 image of an advertisement to be replaced; 

37 a field grabber operative to grab and 

38 digitize at least one field representing at least a 
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1 portion of a sports facility; and 

2 a field-memory matcher operative to match at 

3 least a portion of a field to at least a portion of the 

4 stored image of the advertisement to be replaced, 

5 thereby to identify an image of at least a portion of 

6 the advertisement to be replaced within the field. 
7 

8 19. Apparatus according to claim 18 and also 

9 comprising an advertisement site detector operative to 

10 identify at least one edge of at least one 

11 advertisement site in at least one field. 
12 

13 20. A broadcasting method comprising: 

14 imaging an event using a plurality of TV 

15 cameras; and 

16 broadcasting the images generated by the 

17 plurality of TV cameras. 
18 

19 21. A method according to claim 20 and wherein 

20 the step of broadcasting also comprises, for each 

21 frame, the step of compressing the images generated by 

22 all but "one of the cameras and mixing the compressed 

23 images onto the signal representing the image generated 

24 by the single remaining camera. 
25 

26 22. A method according to claim 20 or claim 21 

27 and also comprising the step of receiving the broadcast 

28 at a remote location and deriving therefrom information 

29 regarding at least one advertisement displayed at the 

30 event. 
31 

32 

33 23. A method for advertisement site detection 

34 comprising: 

35 grabbing and digitizing at least one field 

36 representing at least a portion of a sports facility; 

37 and 

38 detecting at least one advertisement site in 
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1 at least one field on a basis other than location of - 

2 the advertisement site relative to the sports facility. 
3 

4 24. A method for advertisement incorporation 

5 comprising: 

6 grabbing and digitizing at least one field 

7 representing at least a portion of a sports facility; 

8 and 

9 incorporating a portion of an advertisement 

10 into at least one field at a partially occluded 

11 advertisement site within the sports facility, wherein 

12 the portion of the incorporated advertisement 

13 corresponds to an unoccluded portion of the adver- 

14 tisement site. 
15 

16 25. A method for advertisement site detection 

17 comprising: 
18 

19 grabbing and digitizing at least one field 

20 representing at least a portion of a sports facility; 

21 detecting at least one advertisement site in 

22 at least one field; and 

23 tracking at least one advertisement site 

24 detected by the advertisement site detector without 

25 tracking an entire field. 



26. A method according to claim 22 wherein the 

information regarding the advertisement includes 
information pertaining to occlusion of the 
advertisement. 



34 27. A method for advertisement image detection 

35 comprising: 
36 

37 grabbing and digitizing at least one field 

38 representing at least a portion of a sports facility; 
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2 detecting at least one advertisement image in 

3 at least one field; and 

4 counting the length of the exposure time 

5 period of each advertisement image. 
6 

7 
8 

9 28. A method for incorporation of an audio 

10 advertisement into an audio channel representing a 

11 sports event, the apparatus comprising: 

12 storing an audio advertisement; and 

13 mixing the audio advertisement into an audio 

14 channel representing the sports event. 
15 

16 29. A method for advertisement site detection 

17 comprising: 
18 

19 storing an image of an advertisement to be 

20 replaced; 

21 grabbing and digitizing at least one field 

22 representing at least a portion of a sports facility; 

23 and 

24 matching at least a portion of a field to the 

25 stored image of the advertisement to be replaced, 

26 thereby to identify an image of the advertisement to be 

27 replaced within the field. 
28 

29 30. Apparatus according to claim 1 wherein the 

30 advertisement site detector is operative to detect at 

31 least one partially occluded advertisement site in at 

32 least one field on a basis other than location of the 

33 advertisement site relative to the sports facility. 
34 

35 31. Apparatus according to claim 4 wherein the 

36 advertisement site tracker is operative to track at 

37 least one partially occluded advertisement site 

38 detected by the advertisement site detector without 

m 
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1 tracking an entire field. 
2 

3 32. Apparatus according to claim 18 wherein the 

4 advertisement is partially occluded within the field 

5 and wherein the field-memory matcher is operative to 

6 match only a portion of a field to only a portion of 

7 the stored image of the advertisement to be replaced, 

8 thereby to identify an image of only a portion of the 

9 advertisement to be replaced within the field. 
10 

11 33. A TV camera array monitoring system for 

12 monitoring a TV camera array comprising at least one TV 

13 camera generating images to be broadcasted, the system 

14 comprising: 

15 for each TV camera, a camera FOV center 

16 direction measurement unit; 

17 for each TV camera, a lens zoom state 

18 monitoring unit; and a video mixer operative 

19 to mix the outputs of the FOV direction measurement and 

20 lens zoom state monitoring units onto a signal to be 

21 broadcasted. 
22 

23 34. A system according to claim 3 3 wherein the 

24 array comprises a plurality of TV cameras and also 

25 comprising an on— air camera identification unit 

26 operative to identify the TV camera from among the 

27 plurality of TV cameras which is currently on-air. 
28 

29 35. A system according to claim 33 or claim 34 

30 and also comprising a remote advertisement detector 

31 operative to receive the broadcast signal and to 

32 extract the output of the video mixer therefrom. 
33 

34 
35 
36 
37 
38 
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